AI Masterclass Blog
Explanations, background, and advice for curious students.
Latest articles

What you can do with an AI degree
Seven jobs that a degree in artificial intelligence, computer science, mathematics, or statistics leads to, with the institutions behind them, the share of a week spent on data, code, mathematics, and writing, and the honest words about how many stay in research.

How to read an AI paper as a beginner
A machine learning paper is read in an order that is not the order it is printed in: the abstract, then the figures, then the main results table, then the ablations, and only then the method. The 2015 residual networks paper as the worked example, with the places where the caveats hide.

Does a language model know what it is talking about?
Train a small transformer on nothing but lists of moves from the board game Othello, with no picture of the board, and ask whether it holds the board in its head. A probe says yes; editing the board inside the network and watching the move change says it uses it.

How AlphaFold predicts the shape of a protein
A protein is a chain of amino acids that folds into a shape, and the shape is what it does. For fifty years predicting the shape from the chain was an open problem. In November 2020 a network did it to within the width of an atom, and in 2024 the Nobel Prize in Chemistry followed.

How a language model is turned into an assistant
A model that has read the internet continues text; it does not answer questions. Three stages turn it into an assistant: demonstrations, comparisons, and a reward with a leash. The InstructGPT numbers of 2022, and the Bradley-Terry probability worked for two answers.

Why bigger models kept getting better, and the rule for how big
In 2020 the loss of a language model was found to fall as a straight line on a log-log plot of compute, parameters, and data. In 2022 a 70 billion parameter model beat one four times its size by being trained on more text. The scaling laws, the Chinchilla rule, and what one training run costs in electricity.

Ten equations every AI student should know
The field runs on a small number of equations, and most are the same three ideas in different clothes: a dot product, a probability, a gradient. Ten of them, each in one line and one paragraph, from the first unit to the last.

How many games does it take to learn Atari?
In 2015 one network learned 49 Atari games from the pixels on the screen, with the same settings for every game. It needed 50 million frames per game, about 38 days of continuous play. A person needs an evening. The gap is the central problem of reinforcement learning.

What attention actually computes
Three tokens, four numbers each, three small matrices, and the formula that runs every transformer. Queries, keys, and values worked by hand to the output, and the reason the scores are divided by the square root of two.