Scribd
Upload
19 views3 pages

6

Uploaded by

Siddhartha Negi
Copyright
© © All Rights Reserved
We take content rights seriously. If you suspect this is your content, claim it here.
Available Formats
Download as DOCX, PDF, TXT or read online on Scribd
19 views3 pages

6

Uploaded by

Siddhartha Negi
Copyright
© © All Rights Reserved
We take content rights seriously. If you suspect this is your content, claim it here.
Available Formats
Download as DOCX, PDF, TXT or read online on Scribd
You are on page 1/ 3

I'll break down the best learning resources for each major topic, organized by

difficulty level and type of content.

Foundation Topics:

1. Transformer Architecture & Language Models


- Video Courses:
- Andrej Karpathy's "Let's build GPT" (YouTube) - Excellent from-scratch
implementation
- DeepLearning.AI's "Natural Language Processing Specialization" on Coursera
- Stanford CS224N (free on YouTube)

- Written Resources:
- Jay Alammar's blog "The Illustrated Transformer"
- Hugging Face Transformers course (free)
- "The Annotated Transformer" by Harvard NLP

- Hands-on Implementation:
- minGPT by Andrej Karpathy (GitHub)
- Hugging Face Transformers library documentation
- PyTorch Transformer tutorial

2. Diffusion Models
- Video Resources:
- Stanford CS236G lectures on diffusion models
- Outlier's "Diffusion Models from Scratch" course

- Written Resources:
- Lilian Weng's blog post on diffusion models
- AssemblyAI's diffusion model tutorial series
- HuggingFace Diffusers documentation

- Implementation Resources:
- Diffusers library by Hugging Face
- lucidrains' denoising-diffusion-pytorch (GitHub)
- CompVis/stable-diffusion repositories

Advanced Topics:

3. RLHF & Model Alignment


- Primary Resources:
- Anthropic's Constitutional AI paper
- DeepMind's "Training language models to follow instructions"
- OpenAI's InstructGPT paper

- Implementations:
- TRL library by Hugging Face
- TRLX repository
- CarperAI's RLHF tools

4. Model Optimization & Deployment


- Courses:
- AWS Machine Learning University (free)
- Full Stack Deep Learning course
- MLOps Specialization on Coursera

- Tools & Frameworks:


- ONNX documentation
- TensorRT guides
- Hugging Face Optimum library

Specialized Tracks:

5. Multimodal Models
- Papers & Implementations:
- CLIP paper and OpenAI blog
- Stable Diffusion explanation series
- Microsoft's Florence paper

- Practical Resources:
- MultiModal Deep Learning course by UMich (YouTube)
- LAION AI's resources
- OpenAI's DALLE papers

6. Audio Generation
- Primary Resources:
- AudioCraft by Meta
- Tortoise TTS repository
- MusicGen documentation

- Tutorials:
- Hugging Face Audio course
- Stanford's CS224S course
- AudioLDM paper and code

7. 3D Generation
- Core Resources:
- NeRF paper and tutorial
- Instant NGP implementation
- Point-E by OpenAI

- Learning Materials:
- Nvidia's Kaolin library tutorials
- Get3D paper and resources

You might also like