A free, interactive course Β· math β†’ transformers

Attention is just a
dot product.

Every line of an LLM paper is built from math you met once and half remember. This course rebuilds it β€” vectors to attention to LoRA, one interactive lesson a day β€” until the equations read like code.

Start Lesson 1 β†’ free Β· no signup Β· works offline
qk
qΒ·k = 22.6ΞΈ β‰ˆ 50Β° β€” pointing together

Fig. 1. Attention scores every pair of tokens with exactly this number. Drag either arrow β€” watch what agreement does to it.

β€œI write code, but the math side scares me.”

You build things and call model APIs, and you'd like to know what's actually happening inside. Every symbol here gets introduced before it's used.

β€œI never really got the math.”

Still in school, or it just never stuck β€” that's fine. This starts at β€œwhat is a vector” and assumes nothing beyond basic algebra.

β€œI want to read the actual papers.”

You follow the announcements and skim the abstracts. The whole point of this course is that you can open the paper itself and follow it.

  1. One lesson a day.

    A new lesson comes out daily, with a short video. Everything already released stays open, so you can catch up whenever.

  2. You learn by doing.

    Lessons are interactive β€” drag the vectors, change the numbers, watch the formulas respond. Reading alone doesn't build intuition; poking at things does.

  3. A quick check locks it in.

    Pass the lesson's quiz to unlock the next one; chapter exams need 90%. It sounds strict, but it's the reason the later chapters feel manageable.

Vectors β†’ calculus β†’ probability β†’ optimization β†’ the transformer, block by block β†’ training a small LLM β†’ fine-tuning with LoRA and RLHF β†’ the modern stack: MoE, FlashAttention, Mamba.

2 courses96 lessons8 chapter examsevery lesson interactive

The math is actually worked out
Every formula comes with the arithmetic done in front of you, with real numbers. Nothing is left as β€œan exercise for the reader.”
Figures you can play with
Almost every idea comes with a small interactive figure instead of a static diagram β€” like the one at the top of this page.
Nothing appears before it's taught
Lessons unlock in order, so you're never hit with a symbol or concept that hasn't been explained yet.
Works offline, no account needed
Install it like an app and the whole course caches. Progress lives in your browser β€” signing in is only for syncing between devices.

Every expert you follow started with vectors.

Start Lesson 1 β€” it's free