The practical, end-to-end online course that teaches you how RL is used to fine-tune LLMs, through clear explanations and hands-on labs.Â
Â
Join the programÂ
Join us to learn how to:
-
Explain the full LLM training stack and where RL fits
-
Choose between PPO/DPO/GRPO/GSPO for real use cases
-
Design reward signals (including verifiable rewards)
-
Build a simple tool-using agent and fine-tune it with RL
-
Debug RL fine-tuning with practical diagnostics
Â
Who is this course for?
Â
-
ML / LLM engineers and applied scientists who want practical RL-for-LLMs skills
-
Data scientists who can code but want to understand and implement RLHF-style training
-
Builders working on agents, tool use, reasoning, or reliability improvementsÂ
-
You should be comfortable with: Python + basic deep learning concepts.
Â
Program Overview
Live virtual sessions
Learn directly from five well-known instructors who teach clearly and build things that work.Â
The live sessions start on August 5th. We will meet on Wednesdays and Fridays at 11:00am ET / 8:00 am PT.Â
Access to labsÂ
and a learning platform resources available for you to learn on your own schedule
CommunityÂ
You won’t be learning alone. Expect structured support and a place to ask questions as you go.
You’ll also get access to:
- Step-by-step coding labs (including an agent you’ll build and improve)
- Templates, notebooks, and reference implementations
- Recommended readings + “cheat sheets” for key methods
- Replays (so you can review anything you missed)
Course curriculumÂ
Â
Module 1: The Essential Concepts of Reinforcement Learning
with Josh Starmer
A clean foundation: environments, rewards, policies, and how RL differs from supervised learning. You’ll see RL in action and code a simple example to make optimal decisions under uncertainty.
Â
Module 2: The Evolution of RL for LLMs: RLHF → Verifiable Rewards
with Maarten Grootendorst
Understand common reinforcement learning algorithms, like PPO and GRPO, along with several use cases such as reasoning, tool use, and test-time reinforcement learning.
Â
Module 3: GRPO Deep Dive
with Luis Serrano
A focused, intuitive deep dive into GRPO—what’s happening under the hood, why it works well for verifiable rewards, and what tradeoffs to watch.
Â
Module 4: Labs 1–2: Setting up the Calculator Agent
with Chris McCormick
You’ll build the full scaffold: prompts, tool interface, evaluation loop, and a reward signal that can be verified.
Â
Module 5: Lab 3: Dissecting a GRPO training run
with Jay Alammar
Put it all together: an in-depth look at a full RL training run, the systems involved, and what changes across the training run.
Â
BONUS Module: Join us for an "Ask Us Anything"Â
Whether you have additional technical or career questions, the full team will be available for you.Â
Faculty
Â
Â
Jay Alammar is a machine learning researcher and writer, co-author of Hands-On Large Language Models: Language Understanding and Generation, whose illustrated articles have helped millions visually understand transformers and modern NLP.
Â
Maarten Grootendorst is a data scientist and creator of popular NLP libraries like BERTopic and KeyBERT, and co-author of Hands-On Large Language Models: Language Understanding and Generation, bridging cutting-edge research with practical tools.
Â
Chris McCormick is a leading AI educator and researcher whose deep-dive tutorials on BERT, transformers, and NLP have become go-to references for practitioners worldwide, combining rigorous understanding with clear, implementation-ready code.
Â
Luis Serrano is an ex-Google, ex-Apple AI scientist, educator, and author of Grokking Machine Learning, dedicated to making complex ideas intuitive and accessible through the Serrano Academy platform.
Â
Josh Starmer is the founder of StatQuest and author of The StatQuest Illustrated Guide to Machine Learning and The StatQuest Illustrated Guide to Neural Networks and AI, known for turning intimidating concepts into clear, joyful explanations.
At the end of the course you'll receive a certificate of completion
"This class was incredibly valuable for understanding the foundations of RL in LLMs, especially GRPO. The explanations were excellent, and the illustrations made even difficult formulas surprisingly easy to follow."
- Christiana
"A must-take course for anyone who wants to learn RL for LLMs. All the instructors were expert in their field, and I learned a lot of things that were very difficult for me to understand earlier."
- Rohan
"A masterclass in modern AI alignment that bridges the gap between theory and real-world implementation. This curriculum transforms complex concepts like GRPO and RLHF into clear, actionable knowledge."
- Eduardo