Generative AI
Generative AI
various types of content, including text, imagery, audio and synthetic data.
The recent buzz around generative AI has been driven by the simplicity of
new user interfaces for creating high-quality text, graphics and videos in a
matter of seconds.
Two additional recent advances that will be discussed in more detail below
have played a critical part in generative AI going mainstream: transformers
and the breakthrough language models they enabled. Transformers are a
type of machine learning that made it possible for researchers to train ever-
larger models without having to label all of the data in advance. New
models could thus be trained on billions of pages of text, resulting in
answers with more depth. In addition, transformers unlocked a new notion
called attention that enabled models to track the connections between
words across pages, chapters and books rather than just in individual
sentences. And not just words: Transformers could also use their ability to
track connections to analyze code, proteins, chemicals and DNA.