ChatGPT For Everyone

Aishwarya Reganti

A compiled selection of resources that explain the fundamentals of chatgpt and generative AI in a
step-by-step fashion to assist with workings or leverage ChatGPT to its fullest potential.

Index
1. How to read this guide?
2. Deep Learning Basics
a. Neural Networks
b. Generative Models
c. Transformers and Large Language Models
3. ChatGPT: Introduction and Architecture
4. ChatGPT: Applications
a. Interesting ChatGPT Applications
5. ChatGPT Optimization for Personal & Business Use Cases
a. Prompt Engineering
b. Compliance, Privacy and Ethics

1
How to read this guide?
This guide has been developed with the purpose of providing knowledge to everyone interested in
learning more about ChatGPT. If you are reading this guide, it is likely that you are either someone:

1. Who is not familiar with Machine Learning (ML), yet has heard about ChatGPT and would like to
comprehend how it works
2. Who has some knowledge of ML, but isn’t well versed with deep learning (or generative
models) and would like to work with a roadmap to start learning about architecture details.
3. Who is enthusiastic about the concept of ChatGPT and wishes to utilize it in their business
applications or personal life, but is not eager to discover the specifics of its construction

If you fall into the first group, it is highly advised that you first become familiar with the fundamentals
of Machine Learning, in which case the resources in this guide might not be adequate. If you are in the
second or third group, look at the illustration above to position yourself and identify where you fit in
and make a decision on which chapter to start from.

The chapters in this resource provide a brief overview of the topics, followed by a comprehensive list
of courses, videos, articles, and blogs. For those who are short on time and only want a general
understanding, it is suggested to read the articles and blogs. However, for a more in-depth knowledge,
one of the courses from the list, suited to your learning style, should be taken before moving on to the
next chapter. All of the listed resources are available for free.

Hope that this guide provides a clear path for learning about ChatGPT. If you findd this guide helpful,
you can discover more related resources on my LinkedIn account where I frequently share machine
learning content.

Happy Learning!

Aishwarya Reganti

2
2. Deep Learning Basics
Deep learning is the branch of machine learning where neural networks are used to analyze large
datasets and make decisions based on the input. Some basic deep learning terminology you should
know are:

Neural networks: A neural network is a computing system made up of interconnected layers of

artificial neurons that are used to store and process information. Neural networks are used to identify
patterns, make predictions, and classify data.

Backpropagation: Backpropagation is the process of training a neural network by adjusting the

weights of the connections between neurons to minimize the overall error.

Activation functions: Activation functions are used to activate neurons in a neural network, and can
be used to control the output of a neuron. Examples of activation functions include sigmoid, ReLU, and
tanh.

Gradient descent: Gradient descent is an optimization algorithm used to train neural networks. It
adjusts the weights of the neural network in order to minimize the error.

Convolutional Neural Networks: A convolutional neural network (CNN) is a type of neural network
that is used to analyze and classify images. CNNs are typically made up of convolutional and pooling
layers.

Recurrent Neural Networks: Recurrent neural networks (RNNs) are a type of neural network that can
process sequential data. RNNs are used to analyze time-series data such as audio and text.

A. Neural Networks and Basic Deep Learning

● Courses and Videos
1. Neural Networks and Deep Learning on Coursera
2. Introduction to Deep Learning by Carnegie Mellon University (My personal
favorite!)
3. Introduction to Deep Learning on Coursera
4. Practical Deep Learning on course.fast.ai
5. Neural Networks: Zero to Hero by Andrej Karpathy
6. MIT Introduction to Deep Learning 6.S191 on YouTube

3
 ● Blogs, Articles and Publications
1. MIT Deep Learning Basics: Introduction and Overview with TensorFlow
2. What is Deep Learning and How Does It Works [Explained] blog on Simplilearn
3. Neural Networks, Manifolds, and Topology blog on Colah’s blog
4. Deep Learning Architectures Comparative Analysis blog on aman.ai
5. Deep Learning book by Yoshua Bengio, Ian Goodfellow and Aaron Courville
6. Deep Learning Papers Reading Roadmap repository for research papers in
specific DL areas on Github

B. Generative Models
ChatGPT belongs to a class of deep learning models called generative models, so are all the recent
open-sourced models like MidJourney, Stability AI, Dall-E etc. Some background in generative AI can
help understand the fundamental design of these models.

Deep learning models (or machine learning models in general) can be divided into two types -
generative and discriminative.

Image Source: https://dataisutopia.com/blog/discremenet-generative-models/

Generative models Generative models are a type of machine learning algorithms that are used to
generate new content, such as images, text, audio, and video. They are used to teach computers to
understand the underlying structure of data, and then generate new data based on this understanding.
Generative models use a variety of techniques, from probabilistic models to neural networks, to create
new data from existing data. Generative models can be used to create new art, write new stories,
produce video game characters, and much more.

4
Discriminative models are supervised learning algorithms used for classification tasks. They produce
a function that assigns a label to an input based on its features. Discriminative models learn the
boundary between the classes of data, as opposed to generative models which learn the probability
distribution of the data. Commonly used discriminative models include logistic regression, support
vector machines (SVMs), and decision trees.

● Courses and Videos

1. Deep Generative Models course by Stanford
2. Generative Models on Coursera
3. Generative Adversarial Network course by Google
4. Deep Generative Models Lecture by Aditya Grover
5. MIT 6.S191: Deep Generative Modeling Lecture on YouTube

● Blogs, Articles and Publications

1. An Introduction to Deep Generative Modeling research paper by Lars Ruthotto and
Eldad Haber
2. Chapter 20 from Deep Learning book (Deep Generative Models)
3. Generative Deep Learning book by David Foster
4. What is a Generative Model? blog by Google
5. Generative Models repository on GitHub
6. OpenAI Blog on Generative Models
7. Causal GAN Papers website
8. List of Generative Models Articles on Paperspace Blog
9. List of Generative Models Articles on Lil'Log website
10. Generative AI: A Creative New World blog by Sequoia Capital

C. Transformers and Large Language Models

ChatGPT is a generative model, but what it essentially generates is text which is the basis or the script
of a language. A language model is a probabilistic model that is used to predict the likelihood of the
occurrence of a word given the preceding words in a sentence or phrase. It is used to estimate the
probability of a new sentence that is generated by a computer program. Language models are used in
natural language processing (NLP) to estimate the likelihood of a sentence or phrase being spoken or
written by a human being. They are also used to generate text and speech in computer-generated
applications such as machine translation and text-to-speech applications.

5
 Image Source: https://docs.cohere.ai/docs/introduction-to-large-language-models

Language models are generally trained using the self-supervised learning paradigm. Self-supervised
learning is a type of machine learning which allows models to teach themselves by using part of the
input data to learn the other part. It's also sometimes referred to as predictive or pretext learning. One
architecture for building large language models is the transformer architecture. Large language
models such as Google's BERT, OpenAI's GPT-3 (ChatGPT’s base model), and Microsoft's XLNet are all
based on Transformers. (Transformers or foundational models in the below diagram) are a type of
neural network architecture that allow information to be passed between different components of the
network, allowing for a better understanding of language and the ability to generate more
sophisticated and accurate results.

Image Source:https://blogs.nvidia.com/blog/2022/03/25/what-is-a-transformer-model/

6
 ● Courses and Videos
1. CS324 – Large Language Models course by Stanford
2. COS 597G (Fall 2022): Understanding Large Language Models course by Princeton
3. Transformers course by Hugging Face
4. CS25 - Transformers United Course by Stanford
5. Natural Language Processing: NLP With Transformers in Python course on Udemy
6. Lecture 4: Transformers lecture on Full Stack Deep Learning
7. Let's build GPT: from scratch, in code, spelled out. Tutorial by Andrej Karpathy

● Blogs, Articles and Publications

1. Language Models are Unsupervised Multitask Learners GPT-2 paper
2. What Is a Transformer Model? Blog by NVIDIA
3. Attention Is All You Need paper
4. The Illustrated Transformer Blog by Jay Alammar
5. Transformer: A Novel Neural Network Architecture for Language Understanding blog
by Google Research
6. Transformers: What They Are and Why They Matter article on AIExchange
7. How Can We Know When Language Models Know? On the Calibration of Language
Models for Question Answering paper
8. Language Models (Mostly) Know What They Know paper
9. Deduplicating Training Data Makes Language Models Better paper

3. ChatGPT: Introduction and Architecture

ChatGPT is the latest groundbreaking language model from OpenAI that is designed to excel in
interactive conversations and generate text with greater precision, detail, and coherence. The creators
have used a mix of Supervised Learning and Reinforcement Learning, particularly RLHF
(Reinforcement Learning from Human Feedback), to fine-tune the model and ensure that it produces
accurate and unbiased results. This technology represents the next generation in OpenAI's line of
Large Language Models and promises to revolutionize the way we interact and communicate with AI.

OpenAI states that ChatGPT was trained using similar methods as InstructGPT, but with slight
variations in the data collection process. As of now, specific and detailed information about ChatGPT
has not been released to the public. The below diagram explains the architecture used in InstructGPT

7
 Image Source: https://arxiv.org/pdf/2203.02155.pdf

● Courses and Videos

1. ChatGPT - Explained! video by CodeEmporium
2. Chat GPT Rewards Model Explained! video by CodeEmporium
3. How ChatGPT is Trained video by Ari Seff
4. Transformer based new AI Language Models - Chat GPT 3 by OpenAI video by Rahul
Mahajan

● Blogs, Articles and Publications

1. Training language models to follow instructions with human feedback paper
2. ChatGPT-what is it and how does it work exactly? blog on Medium
3. How ChatGPT Works: The Model Behind The Bot blog on Towards Data Science

8
4.ChatGPT: Applications
OpenAI's ChatGPT model has a wide range of potential applications, which fall under the below
categories:

Conversational AI: ChatGPT can be used to build conversational AI systems, such as chatbots, that
can respond to user queries in a natural and human-like manner.

Text Generation: ChatGPT can be used to generate new text based on a prompt, such as generating
news articles, creative writing, or generating responses in a chatbot.

Question Answering: ChatGPT can be fine-tuned for question-answering tasks, where it can answer
questions based on the provided context.

Text Summarization: ChatGPT can be used to automatically summarize long documents or articles
into a shorter, more concise form.

Text Classification: ChatGPT can be used for text classification tasks, such as sentiment analysis or
spam detection.

Dialogue Management: ChatGPT can be used in dialogue systems to generate appropriate responses
in a conversation.

Since its creation, people have been exploring the potential of ChatGPT and creating browser
extensions and application prototypes to extend its capabilities. A few of the most popular examples
are detailed below.

A. Interesting ChatGPT Applications: Resources

1. ChatGPT: Optimizing Language Models for Dialogue OpenAI blog
2. Haystack: An is an open source NLP framework to interact with your data using Transformer
models and LLMs
3. PyChatGPT: A Python client for the unofficial ChatGPT API with auto token regeneration,
conversation tracking, proxy support and more.
4. What practical applications have you already found for ChatGPT? Reddit thread

🤖🤯
5. 5 ideas for your own AI grift with ChatGPT video by Fireship
6. 15+ Unique & Powerful Use Cases Of ChatGPT video by Digital creator Avi
7. How to use ChatGPT to build Business Ideas, Sites & Personal Projects video by Adrian Twarog
8. awesome-chatgpt: A curated list of awesome ChatGPT resources, libraries, SDKs, APIs, and
more.

9
 9. Funny-ChatGPT: a collection of interesting ChatGPT extensions.
10. ChatGPT Search Suggestions: A Chrome extension which provides google search suggestions
to ChatGPT
11. 9 ChatGPT Applications That Will Blow Your Mind With Their AI Capabilities Medium blog
12. State of the art AI: 5 APPS you can build with ChatGPT blog on lablab.ai
13. Using ChatGPT-3 to Make YouTube Videos in Minutes (FULL GUIDE) video by Alex Wilcock
14. How To Use Chat GPT by Open AI For Beginners video by The AI Advantage
15. Making a website using ChatGPT, GitHub Copilot and AI video by Code with Scaler
16. Create Your Chat GPT-3 Web App with Streamlit in Python blog on Medium
17. I Used ChatGPT to Create an Entire AI Application on AWS blog on Towards Data Science
18. How to use GPT-3 tutorial: Build your own GPT-3 Powered application using NextJS and Replit
in 20 minutes blog by lablab.ai
19. Best Examples of ChatGPT on the Internet So Far Medium blog
20. How to use AI Art and ChatGPT to Create a Insane Web Designs video by Codex Community

6. ChatGPT Optimization for Personal &

Business Use Cases
Optimizing ChatGPT's performance can be improved by understanding how it was trained and
constructed. This is beneficial for both personal and business applications, however, there are
additional constraints in business use cases. Two key ways to optimize ChatGPT are through:

1. Prompt engineering to provide optimal generation directions

2. Getting a deeper understanding of compliance, privacy and ethical concerns while using large
language models like ChatGPT

Both of these methods are discussed in further detail with accompanying resources for deeper
understanding.

A. Prompt Engineering
Prompt engineering for ChatGPT involves carefully crafting the input prompts used to initiate the
conversation with the model. This includes selecting the right words, phrasing, and context to guide
the model in generating a specific response. By carefully designing the input prompts, it is possible to
steer the model towards a particular type of response and improve the overall quality of its output.

10
The goal of prompt engineering is to get the best response from the model by providing it with the
right context and information.

By using prompt engineering, one can improve the overall quality of the model's output and make it
more useful and effective for specific use cases.

● Courses and Videos

1. Master Prompt Engineering with ChatGPT course on Udemy
2. How to Talk to ChatGPT: An Intro to Prompt Engineering video by Hackernoon
3. ChatGPT3 Prompt Engineering course by mattnigh
4. Advanced ChatGPT Prompt Engineering video by James Bachini
5. ChatGPT Guide: 10x Your Results with Better Prompts video by The AI Advantage
6. ChatGPT Prompt Hack: The Amazing “Let’s think about this” Prompt video by All About
AI

● Blogs, Articles and Publications

1. Pre-train, Prompt, and Predict: A Systematic Survey of Prompting Methods in Natural
Language Processing research paper
2. awesome-chatgpt-prompts github repository
3. ChatGPT-Prompt-Genius github repository
4. Prompt Programming for Large Language Models: Beyond the Few-Shot Paradigm
Research paper
5. Promptstacks: A website that provides free curated prompts
6. How to go deeper with ChatGPT using prompt engineering blog on Technical.ly
7. What Is AI Prompt Engineering: Examples, And More (2023) blog on Dataconomy
8. How To Get the Best From ChatGPT With Prompt Engineering blog on Medium
9. 10 Amazing Resources For Prompt Engineering, ChatGPT, and GPT-3 blog on Medium
10. The Art of ChatGPT Prompting: A Guide to Crafting Clear and Effective Prompts e-book

A. Compliance, Privacy and Ethics

There are several concerns when using GPT-based models like ChatGPT especially in customer facing
production and business use cases, including:

1. Bias: Language models like ChatGPT have been shown to have biases that are inherent in the
data they were trained on.

11
 2. Misinformation: ChatGPT was trained on a diverse range of internet text, which includes
inaccuracies and falsehoods, so there is a risk of spreading misinformation through its
outputs.
3. Privacy and Security: If the input data to ChatGPT contains sensitive information, there is a
risk of privacy and security breaches.
4. Lack of Context Awareness: ChatGPT does not have a complete understanding of context and
can generate outputs that are inconsistent or irrelevant in a given context.
5. Cost: Generating responses from a language model like ChatGPT can be computationally
expensive, which can make it cost-prohibitive for some production use cases.
6. Quality Control: ChatGPT outputs may need to be reviewed and filtered for content that is
inappropriate, malicious, or offensive.
7. Adversarial examples: GPT models can be vulnerable to adversarial examples, which are
intentionally constructed inputs designed to trick the model into making incorrect predictions.
8. Explainability and transparency: GPT models are often viewed as black boxes, making it
difficult to understand how they arrive at their predictions and to debug and improve them.
9. Performance: GPT models can be resource-intensive to run in real-time, requiring large
amounts of computational resources, memory, and power.

Below are some sources which provide insight into the possible issues that may arise when using
chatgpt as well as potential solutions.

● Resources
1. What Does ChatGPT Really Mean For Businesses? article on Forbes
2. ChatGPT has major issues that startups and Big Tech alike should care about article on
Insider Intelligence
3. https://iblnews.org/chatgpt-and-its-consequences-on-work-and-life-are-the-talk-of-th
e-business-leaders-in-davos-this-year/ article on IBL News
4. ChatGPT: Enterprises Eye Use Cases, Ethicists Remain Concerned article on
InformationWeek
5. ChatGPT and How AI Disrupts Industries article on Harvard Business Review
6. ChatGPT: An Author Without Ethics article on InformationWeek
7. I Interviewed ChatGPT About AI Ethics — And It Lied To Me article on Forbes
8. Addressing ChatGPT's Shortfalls in Data Protection Law Compliance article on
InfoSecurity
9. Is ChatGPT's use of people's data even legal? blog on Avast
10. ChatGPT, AI, and the future of privacy blog on Proton
11. Generative AI ChatGPT Can Disturbingly Gobble Up Your Private And Confidential Data,
Forewarns AI Ethics And AI Law article on Forbes

12
—----------------------------------------—------------------------------------------—-----------------------------------------—---

—----------------------------------------—------------------------------------------—-----------------------------------------—---

—----------------------------------------—------------------------------------------—-----------------------------------------—---

Thank You!

If you found this guide helpful, you can discover more related resources on my LinkedIn where I
frequently share machine learning content.

Aishwarya Reganti

https://www.linkedin.com/in/areganti/

—----------------------------------------—------------------------------------------—-----------------------------------------—---

—----------------------------------------—------------------------------------------—-----------------------------------------—---

—----------------------------------------—------------------------------------------—-----------------------------------------—---

13