ChatGPT

Dr. Monika
Department of Computer Science and Applications
Kurukshetra University

Dr. Monika,DCSA(KUK) 1
Dr. Monika,DCSA(KUK) 2
Introduction
ChatGPT is a trained model which interacts in a
conversational way.
The dialogue format makes it possible for ChatGPT to
answer followup questions, admit its mistakes,
challenge incorrect premises, and reject inappropriate
requests.
It is a chatbot developed by "OpenAI" and launched in
november 2022.

Dr. Monika,DCSA(KUK) 3
It bulit on top of OpenAl's GPT-3 family of large
language models and has been fine tuned.
CHATGPT was launched as a prototype on november
30,2022 and quickly garnered attention for its detailed
responses and articulate answers across many
domains of knowledge

Dr. Monika,DCSA(KUK) 4
Dr. Monika,DCSA(KUK) 5
Dr. Monika,DCSA(KUK) 6
Dr. Monika,DCSA(KUK) 7
Dr. Monika,DCSA(KUK) 8
CHATBOTS
A computer program designed to simulate human
conversation.

Rule-based chatbots
Retrieval-Based Chatbots
Generative AI chatbots

Dr. Monika,DCSA(KUK) 9
Dr. Monika,DCSA(KUK) 10
Dr. Monika,DCSA(KUK) 11
Dr. Monika,DCSA(KUK) 12
The Novelty of ChatGPT
Chat GPT stands for Chat Generative Pre-Trained
Transformer and was developed by an AI research
company, Open AI.
It is an artificial intelligence (AI) chatbot technology
that can process our natural human language and
generate a response.

Dr. Monika,DCSA(KUK) 13
Dr. Monika,DCSA(KUK) 14
Dr. Monika,DCSA(KUK) 15
Dr. Monika,DCSA(KUK) 16
Dr. Monika,DCSA(KUK) 17
Reinforcement learning from human feedback (RLHF)

RLHF is a machine learning approach that combines

reinforcement learning techniques, such as rewards
and comparisons, with human guidance to train an
artificial intelligence (AI) agent. It has three main
steps:

 Supervised fine tuning model

 Reward Model
 Reinforced learning model

Dr. Monika,DCSA(KUK) 18
 e st re su l t
To o l k it for b

Dr. Monika,DCSA(KUK) 19
Dr. Monika,DCSA(KUK) 20