Skip to content
AI EngineeringPro

Make a model follow the behavior you need.

Fine-Tuning LLMs: Make the Model Yours

Use one real tiny GPT to study training data, SFT, LoRA and QLoRA, DPO, distillation, quantization, and the decision to fine-tune at all.

What you will leave with

You can choose an adaptation method, prepare the data and objective, measure the result, and carry the same reasoning to larger models.

Modules
8
Duration
~7 hours
Level
Intermediate to Advanced
Access
Module 1 free
  • Real 1.09M-param model
  • SFT · LoRA · DPO · distillation
  • Every number measured
  • CPU-reproducible repo

What you will be able to do

What this course prepares you to do.

The curriculum is organized around these 4 practical outcomes.

Decide when fine-tuning is justified

Prepare clean instruction and preference data

Implement SFT, LoRA, and DPO objectives

Evaluate distillation and quantization tradeoffs

Curriculum

Every module earns the next one.

Open a module to inspect every section before you start. Your progress follows you through the course.

01
Module 1

The Decision: What Fine-Tuning Actually Changes

BeginnerFree preview

context, system controls, and weights, prompt / few-shot / RAG / fine-tune, InstructGPT: 1.3B beat 175B, and more.

View 5 sections
  1. 1The First Decision: Context, System Controls, or Weights
  2. 2The Menu: Prompt, Few-Shot, RAG, Fine-Tune
  3. 3The Proof It Works: 1.3B Beat 175B
  4. 4Meet the Task: StoryByte Ignores You
  5. 5The Scoreboard We Carry
45 min5 sections
Open module
02
Module 2

Data Is the Product: Building the Training Set

BeginnerPro

training examples, special tokens, data failure modes, and more.

View 5 sections
  1. 1What a Training Example Really Is
  2. 2Special Tokens: Growing the Vocabulary
  3. 3Three Failures: When Your Data Can't Teach It
  4. 4Synthetic Data, Honestly Labeled
  5. 5Splits, Leakage, and the Gold Set
50 min5 sections
Open module
03
Module 3

SFT: Teaching by Example

IntermediatePro

supervised fine-tuning, loss masking, overfitting, and more.

View 5 sections
  1. 1The Same Loss, New Data
  2. 2Loss Masking: Grade the Answer, Not the Question
  3. 3The Run: Watching It Learn, Then Overfit
  4. 4Picking the Checkpoint That Matters
  5. 5The Payoff, and the Bill
55 min5 sections
Open module
04
Module 4

LoRA: Fine-Tuning on a Budget

IntermediatePro

low-rank adapters, rank & alpha, merging, and more.

View 5 sections
  1. 1The Insight: The Change Is Low-Rank
  2. 2The Rank Dial
  3. 3The Merge: W + A @ B, Zero Adapter Latency
  4. 4Learns Less, Forgets Less, Measured
  5. 5QLoRA and the Memory Math
55 min5 sections
Open module
05
Module 5

Preference Tuning: DPO and the Over-Optimization Dial

IntermediatePro

preference pairs, RLHF, DPO, and more.

View 5 sections
  1. 1Why SFT Isn't Enough
  2. 2RLHF in One Diagram
  3. 3DPO: The Shortcut
  4. 4The Dial: 25 Steps vs 300
  5. 5Reward Hacking, Caught by the Scoreboard
50 min5 sections
Open module
06
Module 6

Distillation: Shrinking Without Starting Over

AdvancedPro

deploy math, soft targets, distillation temperature, and more.

View 5 sections
  1. 1Why Shrink: The Deploy Math
  2. 2Soft Targets: The Teacher's Runner-Ups
  3. 3The Other Temperature Knob
  4. 4The Race: KD vs Scratch, Measured
  5. 5Modern Distillation and the Imitation Trap
50 min5 sections
Open module
07
Module 7

Ship It: Quantize, Serve, Graduate to Real Models

AdvancedPro

merge & export, int8 quantization, serving math, and more.

View 5 sections
  1. 1Merge and Export: One Artifact
  2. 2int8, Step by Step in Your Browser
  3. 3The Serving Math
  4. 4The Graduation: Same Playbook, Real Model
  5. 5When to Retrain
50 min5 sections
Open module
08
Module 8

The Playbook and the Frontier

AdvancedPro

the method ladder, decision tree, known limits, and more.

View 5 sections
  1. 1The Whole Ladder, One Table
  2. 2The Decision Tree, Now with Evidence
  3. 3What Fine-Tuning Did Not Fix
  4. 4The Frontier, Flagged as Moving
  5. 5Where to Go Next
45 min5 sections
Open module

Who this course is for

Built for people who need to use the skill.

Start with the background you have. The prerequisite notes above tell you exactly what is assumed.

01

AI engineers evaluating fine-tuning

02

ML practitioners moving into post-training

03

Teams comparing prompting, RAG, and weight updates

Start the course

Begin with The Decision: What Fine-Tuning Actually Changes.

Module 1 introduces the language and example used throughout the rest of the course.

Open Module 1
Fine-Tuning LLMs: Make the Model Yours | Let's Data Science