0% found this document useful (0 votes)
14 views34 pages

Generative AI and LLMS

The document provides an overview of Generative AI, including its definition, applications, and the significance of Large Language Models (LLMs) within this field. It explains the relationship between generative models and deep learning, highlights various milestones in LLM development, and discusses the capabilities and architecture of these models. Additionally, it touches on the training processes for models like ChatGPT and lists various open-source LLMs.

Uploaded by

galisunny24
Copyright
© © All Rights Reserved
We take content rights seriously. If you suspect this is your content, claim it here.
Available Formats
Download as PDF, TXT or read online on Scribd
0% found this document useful (0 votes)
14 views34 pages

Generative AI and LLMS

The document provides an overview of Generative AI, including its definition, applications, and the significance of Large Language Models (LLMs) within this field. It explains the relationship between generative models and deep learning, highlights various milestones in LLM development, and discusses the capabilities and architecture of these models. Additionally, it touches on the training processes for models like ChatGPT and lists various open-source LLMs.

Uploaded by

galisunny24
Copyright
© © All Rights Reserved
We take content rights seriously. If you suspect this is your content, claim it here.
Available Formats
Download as PDF, TXT or read online on Scribd
You are on page 1/ 34

Generative AI

What you will learn?


● Generative AI?
● Large Language Models (LLMs)
● OpenAI
● Langchain
● Vector Database
● Llama Index
● Open Source LLM model
● End to End Project
Generative AI
● ChatGPT
● Google Bard
● Meta Llama 2
What is Generative AI?
Generative AI generate new data based on training sample.Generative model
can generate Image,Text, Audio, Videos etc. data as output.

So generative AI is a very huge topics,

- Generative Image model


- Generative Language model
Generative Model:

Question Responses
s
Where Generative AI Exists.
● Machine Learning is the subset of Artificial
Intelligence

● Deep Learning is the subset of Machine Learning

● Generative AI is the subset of Deep Learning


Discriminative vs Generative Model
Discriminative vs Generative Model
Clustering:
● K-Means Classification & Regression:
● DBScan
Generative AI is a subset of deep learning and Generative models are trained on huge amount
of data. While training the generative model we don’t need to provide a label data, It is not possible
when we have a huge amount of data, So, it's just try to see the relationship between the
distribution of the data. In Generative AI we give unstructured data to the LLM model for
training purpose.
What is LLMs?
Large Language Models (LLMs) are foundational machine learning models that use deep learning
algorithms to process and understand natural language. These models are trained on massive amounts
of text data to learn patterns and entity relationships in the language.

It is a language model which is responsible for performing task such as text to text generation , text to
image generation and image to text generations.
What makes LLM so Powerful?
● In case of LLM, one model can be used for a whole variety of tasks like:-

Text generation, Chatbot, summarizer, translation, code generation

& so on …

So, LLM is subset of Deep Learning & it has some properties merge with

Generative AI
Thank You!
Why LLM so Powerful?
● Train the model for a specific task
Few milestone in large language model
● Bard
● GPT
● XLM
● T5
● M2M-100
LLMs
What is LLMs?
A large Language model is a trained deep learning model that understands
and generate text in a human like fashion.

LLMs are good at Understanding and generating human language


Why we call it Large Language Model?
Because of the size and complexity of the Neural Network as well as the size
of the dataset that it was trained on.

Researchers started to make these models large and trained on huge datasets

That they started showing impressive results like understanding complex


Natural Language and generating language more eloquently than ever.
What makes LLM so Powerful?
● In case of LLM, one model can be used for a whole variety of tasks like:-

Text generation, Chatbot, summarizer, translation, code generation

& so on …

So, LLM is subset of Deep Learning & it has some properties merge with

Generative AI
LLMs Model Architecture
Large Language models are based on transformer a type of Neural Network

Architecture invented by Google.


Few milestone in large language model
● BERT: Bidirectional Encoder Representations from Transformers (BERT) was developed by
Google

● GPT: GPT stands for "Generative Pre-trained Transformer".The model was developed by
OpenAI

● XLM: Cross-lingual Language Model Pretraining by Guillaume Lample, Alexis Conneau.

● T5: The Text-to-Text Transfer Transformer It was created by Google AI

● Megatron: Megatron is a large, powerful transformer developed by the Applied Deep Learning
Research team at NVIDIA

● M2M-100: multilingual encoder-decoder (seq-to-seq) model researchers at Facebook


Transformer Tree
OpenAI Based LLM models
Other Open Source Models
● BLOOM
● Llama 2
● PaLM
● Falcon
● Claude
● MPT-30B
● Stablelm

So on ….
What can LLMs be used for?
● Text Classification
● Text Generation
● Text Summarization
● Conversation AI like chatbot, Question Answering
● Speech recognition and Speech identification
● Spelling Corrector

So on……
Prompt Designing
How ChatGPT was trained?
Internally using a LLM which is gpt-3.5 or gpt-4
It has trained on a large amount of data which is available all over the internet.

1. Generative pre-training
2. Supervised fine-tuning
3. Reinforcement learning
Thank You!
Generative Pre-Training
Supervised Fine-Tuning (SFT)
Reinforcement Learning through Human Feedback
(RLHF)
Reference i used: https://www.linkedin.com/pulse/discover-how-chatgpt-
istrained-pradeep-menon/

You might also like