GPT-3 (Q95726734)

From Wikidata
Revision as of 20:12, 7 January 2023 by Inaki.alegria (talk | contribs) (‎Added a language link to connect pages: eswiki:GPT-3, euwiki:GPT-3)
Jump to navigation Jump to search
2020 Transformer-based language model
  • Generative Pre-trained Transformer 3
  • Generative Pretrained Transformer 3
  • GPT3
Language Label Description Also known as
English
GPT-3
2020 Transformer-based language model
  • Generative Pre-trained Transformer 3
  • Generative Pretrained Transformer 3
  • GPT3

Statements

instance of
language model
0 references
autoregressive model
0 references
transformer
0 references
generative model
0 references
part of
OpenAI API
0 references
inception
28 May 2020
0 references
follows
GPT-2
0 references
followed by
ChatGPT
0 references
developer
OpenAI
0 references
software version identifier
125M
alternative name
Small
data size
125,000,000 parameter
1 reference
stated in
Language Models are Few-Shot Learners
350M
alternative name
Medium
data size
350,000,000 parameter
1 reference
stated in
Language Models are Few-Shot Learners
760M
alternative name
Large
data size
760,000,000 parameter
1 reference
stated in
Language Models are Few-Shot Learners
1.3B
alternative name
XL
data size
1,300,000,000 parameter
1 reference
stated in
Language Models are Few-Shot Learners
2.7B
data size
2,700,000,000 parameter
1 reference
stated in
Language Models are Few-Shot Learners
6.7B
data size
6,700,000,000 parameter
1 reference
stated in
Language Models are Few-Shot Learners
13B
data size
13,000,000,000 parameter
1 reference
stated in
Language Models are Few-Shot Learners
175B
alternative name
GPT-3
data size
175,000,000,000 parameter
1 reference
stated in
Language Models are Few-Shot Learners
quotation
To study the dependence of ML performance on model size, we train 8 different sizes of model, ranging over three orders of magnitude from 125 million parameters to 175 billion parameters, with the last being the model we call GPT-3. (English)
publication date
22 July 2020
used by
OpenAI API
0 references
uses
transfer learning
0 references
unsupervised learning
0 references

Identifiers

Know Your Meme ID
40858
0 references
subreddit
GPT3
0 references
 
                  Retrieved from "https://www.wikidata.org/w/index.php?title=Q95726734&oldid=1805861981"