Resources

Terminology

AI Terminology

Key terms and definitions used throughout the course.

Interactive Tools

Hands-on tools for exploring how AI systems work, from text generation to neural networks.

Build a simple text generator from scratch. See how counting word pairs creates a model that can produce surprisingly coherent (and sometimes hilarious) text.

Markov Babbler

Select or paste text to train a simple bigram model, then generate text one word at a time. At each step, you can see the probability distribution over the next possible words.

LLM Probability Explorer

Pedagogy & details →

Watch a real language model predict the next word. Choose a sentence starter, see the probability distribution over possible next words, and build sentences one token at a time.

Log in to use this tool.

Temperature Compare

Pedagogy & details →

See how temperature affects language model output. Compare the same prompt at different temperature settings side-by-side to understand the tradeoff between predictability and creativity.

Log in to use this tool.

Neuron Explorer

Pedagogy & details →

Experiment with a single artificial neuron. Adjust inputs, weights, bias, and activation function to understand the fundamental building block of neural networks.

Neuron Explorer

A neuron listens to signals from its neighbors. Each connection can amplify, dampen, or even reverse a signal. If the total is strong enough, the neuron fires and sends its own signal onward. Try adjusting the sliders to see when this neuron fires.

Signal 1Signal 2NeuronOutput

How strong is each incoming signal?

Signal 1
Signal 2

How much does each connection let through?

Connection 1
Connection 2

How eager is this neuron to fire?

Eagerness

Try These

Hover over a button to see what it does. Try "Your turn!" to test yourself!

Digit Recognition Network

Pedagogy & details →

A real neural network that recognizes handwritten digits. Draw digits to classify them, train the network from scratch and watch it learn, or step through how errors flow backward and adjust weights.

Digit Recognition Network

A neural network that recognizes handwritten digits. 784 → 16 → 16 → 10 neurons.

Pre-trained model

Trained on 60,000 examples before you arrived

0
0.0%
1
0.0%
2
0.0%
3
0.0%
4
0.0%
5
0.0%
6
0.0%
7
0.0%
8
0.0%
9
0.0%
784 pixels0123456789Hidden 1 (16)Hidden 2 (16)Output (10)

Hover over a neuron in the diagram to see what it responds to. Click to pin.

Embedding Explorer

Pedagogy & details →

Explore how AI represents meaning as geometry. Search for words to see what’s nearby, or try analogies to discover that you can do arithmetic on meaning.

Log in to use this tool.

Training Stage Matcher

Pedagogy & details →

See how pretraining, instruction tuning, and RLHF each change the same model’s behavior. Guess which training stage produced a response, then see all three side-by-side.

Log in to use this tool.

Preference Rater

Pedagogy & details →

Experience what RLHF raters do. Compare two AI responses optimized for different values, pick which is better, then see what tradeoff you just made.

Log in to use this tool.

Readings

Other

A Game Plan for the AI Boom

The AtlanticMatteo Wong · 9 min read

AI Agents Are Taking America by Storm

The AtlanticLila Shroff · 9 min read

Economists Are Drawing Stronger Connections Between A.I. and Jobs

The New York TimesBen Casselman · 11 min read

How A.I. Helped One Man (and His Brother) Build a $1.8 Billion Company

The New York TimesErin Griffith · 12 min read

Imagine Losing Your Job to the Mere Possibility of AI

The AtlanticLila Shroff · 8 min read

In 'The AI Doc,' Sam Altman and Dario Amodei Go on the Record

The New York TimesAlissa Wilkinson · 5 min read

No, Netanyahu Is Not Dead

The AtlanticYair Rosenberg · 8 min read

Opinion | I Saw Something New in San Francisco

The New York TimesEzra Klein · 11 min read

Opinion | I Teach Creative Writing. This Is What A.I. Is Doing to Students.

The New York TimesMeghan O'Rourke · 19 min read

Sam Altman May Control Our Future—Can He Be Trusted?

The New YorkerRonan Farrow, Andrew Marantz · 82 min read

The AI Industry Wants to Automate Itself

The AtlanticMatteo Wong, Lila Shroff · 8 min read

The AI Takeover of Education Is Just Getting Started

The AtlanticLila Shroff · 8 min read

The Man Who Thought He Could Keep AI Safe

The AtlanticSebastian Mallaby · 9 min read

The People Outsourcing Their Thinking to AI

The AtlanticLila Shroff · 10 min read

Think Twice Before Asking ChatGPT About Your Health

The AtlanticSage Lazzaro · 10 min read

What Teens Are Doing With Those Role-Playing Chatbots

The New York TimesKashmir Hill, Frances F. Denny · 15 min read

Young People Are Falling Behind, but Not Because of AI

The AtlanticRogé Karma · 9 min read