An open curriculum for modern AI

Read the papers.
Understand the field.

A clear, guided path through the research that built large language models — from attention and scaling to alignment, retrieval, and agents.

Try a free Transformer lesson Browse all papers →

Read, try a question, and see the explanation. No account or payment needed.

CURATED RESEARCH2017 — PRESENTCONCEPTS, NOT HYPE

THE FIELD, IN SEQUENCE

One clear path through a fast-moving field.

01

Foundations

Attention · Transformers · Pre-training

02

Scale & alignment

Scaling laws · Instruction tuning · RLHF

03

Systems

Retrieval · Multimodality · Agents

SELECTED PAPERS

Ideas that changed the trajectory.

Browse all papers
June 2017GUIDED READING

Transformer

Introduced the Transformer, replacing recurrence with self-attention and enabling highly parallel training. Its architecture became the foundation of BERT, GPT, and nearly every modern language model.

Self-AttentionEncoder-DecoderParallelization
Study this paper

HOW IT WORKS

From abstract to intuition.

  1. 01

    See the context

    Understand what problem the paper set out to solve.

  2. 02

    Trace the idea

    Work through the architecture, equations, and key decisions.

  3. 03

    Test the model

    Check your understanding with focused questions and walkthroughs.

YOUR NEXT PAPER

Start with the idea that started it all.

Try the free self-attention lesson. Create an account when you want to save your answers and progress.

Start the free lesson