Public Sector AI: Week in Review
Public Sector AI: Week in Review
If you’re looking for AI/GenAI courses, here are some good options. Reach out to me if you
have questions or if you have recommended additions.
DeepLearning.AI
● Specializations
○ Machine Learning with Stanford (3 courses)
● Courses
○ AI for Everyone (6 hrs)
○ GenAI for Everyone (5 hrs)
○ Generative AI with Large Language Models
Andrej Karpathy
● Intro to Large Language Models (1 hr)
● Let's build the GPT Tokenizer (2:13 hrs)
● Let's reproduce GPT-2 (124M) (4 hrs)
● Let's build GPT: from scratch, in code, spelled out (2 hrs)
● Neural Networks: Zero to Hero (10 videos)
Lectures
● Stanford
○ CS229: Machine Learning
■ Autumn 2018 with Andrew Ng - Syllabus and Lectures
○ CS224N: Natural Language Processing with Deep Learning
■ Winter 2021 with Chris Manning - Syllabus and Lectures
● UC Berkeley
○ CS294/194-196 Large Language Model Agents - Syllabus and Lectures
● Harvard
○ CS50 Tech Talk: GPT-4 - How does it work, and how do I build apps with it (~1
hr)
● MIT
○ Introduction to Deep Learning (1 hr)
○ A Crash Course in Generative AI (20 min)
○ Impact of ChatGPT – Capstone talk with Dr. Stephen Wolfram (1 hr)
○ Impact of ChatGPT – Keynote address by Prof. Yann LeCun (1 hr)
○ Recurrent Neural Networks, Transformers, and Attention (1 hr)
AI Training Resources
Public Sector AI: Week in Review
● Other
○ Stephen Wolfram: What is ChatGPT doing…and why does it work (~ 3 hrs)
○ LLM Bootcamp (Spring 2023)
Other
● Google
○ Introduction to Generative AI (~.5 hrs)
○ Introduction to Large Language Models (~1 hr)
○ Attention Mechanism (~.5 hrs)
○ Transformer Models and BERT Model (~.5 hrs)
○ Introduction to Image Generation (~.5 hrs)
○ Create Image Captioning Models (~.5 hrs)
○ Encoder-Decoder Architecture (~.5 hrs)
● LangGraph
○ Intro to LangGraph (6 hrs)
● HuggingFace
○ NLP
○ Fine-Tuning
● Other
○ Sebastian Raschka: Developing an LLM: Building, Training, Finetuning (1 hr)