Set up your notebook. You will need it at the end of class.
Copy these. Leave space under each one for a definition.
- parameter
- pretraining
- post-training
- freeze
- inference
- knowledge cutoff
Think about these. Nothing to write.
- Next Monday you sit down at a station and type into a model. Today decides what you think is happening on the other end of that.
- Someone has told you an AI got smarter recently. What did they actually mean?
- If the numbers never change, what would it even mean for the AI to be yours?
Copy this into your Lab Notebook and leave room under it. You will answer it at the end of class.
When you send a prompt to an AI model, is the model learning from you?
The words, in plain terms
Six words, and they all serve one line: training is when the numbers change, inference is when they hold still. Nothing today is about hardware.
A language model is not a library. It is not a search engine with a friendly voice attached. Underneath the chat window is something much stranger and much simpler: an enormous collection of numbers. Those numbers are called parameters, and the largest model running on the rig in this course holds roughly twenty six billion of them. Not all twenty six billion run on every word, which is a detail worth returning to, but all of them sit in the file. Every answer that model has ever produced came out of those numbers and nothing else.
A parameter is just a number. It is not a sentence, not a fact, not a small file with information in it. If you could reach into the model and pull out a single parameter, you would find something like 0.0412, and it would tell you nothing at all. No parameter holds the idea that Baton Rouge is the capital of Louisiana. That idea, if the model has it, is spread thinly across billions of numbers at once, in a pattern no person could read directly. This is why nobody can open a model and look up what it knows.
So where did those numbers come from? They came from a process called pretraining. During pretraining, the model is shown staggering amounts of text and given one repetitive job: predict what comes next. It guesses, it is wrong, and every time it is wrong the numbers get nudged. Nudge, guess, nudge, guess, billions of times over weeks or months on machines that cost more than most buildings. Nobody sits down and writes facts into the model. The facts arrive as a side effect of getting better at predicting text.
After pretraining comes a second and much shorter stage called post-training. Pretraining decides roughly what the model knows. Post-training decides how it behaves: whether it answers in full sentences, whether it follows an instruction or wanders off, whether it refuses certain requests. This stage is smaller and more targeted, but it is the reason a raw pretrained model and a finished chat model feel like completely different things.
And then, at some point, the adjusting stops.
This is the moment that matters most today. The numbers are written into a file and locked. This is called freezing, and from that moment forward the model is fixed. It does not get smarter. It does not get worse. It does not update itself overnight. Whatever it learned during training is what it has, permanently, until a company decides to run the whole expensive process again and release a different model.
Freezing produces a side effect you have probably run into without having a name for it. The text the model read had to stop somewhere, on some particular date. That date is called the knowledge cutoff. Ask the model about something that happened after its cutoff and it will not know, and worse, it may not know that it does not know. It will produce a confident, well-formed, completely invented answer, because producing well-formed text is exactly the job it was trained for.
Everything that happens after the freeze has its own name: inference. Inference is what occurs when you type a prompt and press enter. Your text is fed through the frozen numbers, and an answer comes out the other side. That is the entire operation. Nothing inside the model changes. The numbers you used are bit for bit identical to the numbers the person before you used and the numbers the person after you will use.
Which brings us back to the question you answered at the start of class. When you send a prompt to a model, is the model learning from you?
No. It cannot. The learning stage ended before the file was ever copied to the machine you are typing on.
The obvious objection is that it certainly feels like it learns. You tell a chatbot your name and three messages later it uses your name. That is real, and it has a boring explanation. The conversation is not stored inside the model. It is stored outside, in ordinary text, and the entire conversation up to that point is quietly resent with every new message. The model reads the whole transcript fresh each time and responds. Close the window and the transcript is gone, and the model is exactly what it was before you arrived.
Hold onto that, because next week you will be using a tool built to make it obvious. It sends your prompt once, to three models at once, with no memory between prompts. No conversation. No follow-ups. One pass through frozen numbers, three times over, so you can see the machinery instead of the illusion.
B. A parameter is just a number, something like 0.0412, and on its own it tells you nothing. No single parameter holds an idea. Whatever the model knows is spread thinly across billions of them at once, in a pattern no person could read directly.
Notebook: parameter. Say what it is, not what it does.
C. Nobody sits down and writes facts into a model. It is shown enormous amounts of text and given one repetitive job: predict what comes next. It guesses, it is wrong, the numbers get nudged, billions of times over. The facts arrive as a side effect of getting better at that one job.
Notebook: pretraining. Say what changes during it.
B. Pretraining decides roughly what the model knows. Post-training decides how it acts — whether it answers in full sentences, whether it follows an instruction or wanders off, whether it refuses a request. It is much shorter and more targeted, and it is why a raw pretrained model and a finished chat model feel like different things.
Notebook: post-training. Say what it shapes.
A. The adjusting stops. The numbers are written into a file and locked, and from that moment the model is fixed. It does not get smarter, it does not get worse, and it does not update itself overnight. It stays exactly what it is until a company runs the whole expensive process again and releases a different model.
Notebook: freeze. Say what stops.
C. Inference is what happens when you type a prompt and press enter. Your text goes through the frozen numbers and an answer comes out the other side. That is the entire operation, and nothing inside the model changes while it happens.
Notebook: inference. Say what does not change.
B. The text the model read stopped on a particular date, and that date is the knowledge cutoff. Ask about something after it and the model will not know — and worse, it may not know that it does not know. It will produce a confident, well-formed, completely invented answer, because producing well-formed text is exactly the job it was trained for.
Notebook: knowledge cutoff. Say what it explains.
C. The numbers you use are bit for bit identical to the numbers the person before you used and the numbers the person after you will use. Nothing about your prompt writes anything back. That is the whole claim of the day.
B. The conversation is not stored inside the model. It is kept outside, as ordinary text, and the entire transcript up to that point is quietly resent every time you send a new message. The model reads the whole thing fresh and responds. Close the window and the transcript is gone, and the model is exactly what it was before you arrived.
The life of a model
The life of a model
Do the numbers change?
| Stage | What happens | How long | Do the numbers change? |
|---|---|---|---|
| Pretraining | The model reads enormous amounts of text and guesses what comes next. Every wrong guess nudges the numbers. | Weeks to months | Yes. Constantly. This is where knowledge comes from. |
| Post-training | A smaller, targeted stage. Teaches the model to follow instructions, answer in full sentences, and refuse some requests. | Days to weeks | Yes, but far fewer of them, and aimed at behavior instead of knowledge. |
| Freezing | The numbers are written into a file and locked. The file gets copied to servers and to machines like the one in Mr. Muggivan’s house. | A moment | No. This is the moment it stops. |
| Inference | You type a prompt. It runs through the frozen numbers. An answer comes out. | Seconds | No. Not once. Not ever. |
Two things follow from the bottom two rows. The model has a knowledge cutoff, because the reading stopped on a date. The model is not learning from you, because the learning was over before the file reached the machine you are typing on.
What a parameter is, and where it lives
What a parameter is, and where it lives
The arithmetic
The arithmetic
Our numbers, not a textbook’s.
| Model | Total parameters | Active per token | File size at Q4 | Where it runs | Knowledge cutoff |
|---|---|---|---|---|---|
| Gemma 4 E4B | 8,000,000,000 | 4,500,000,000 effective | 6.33 GB | Mr. Muggivan’s rig | January 2025 |
| Gemma 4 26B-A4B | 26,000,000,000 | 4,000,000,000 | 18.2 GB | Mr. Muggivan’s rig | January 2025 |
| Gemini 3.7 Flash | Not published | Not published | Not published | Google’s servers | March 2026 |
These are the three models you will use on Monday. Two of them sit on a machine you could walk up to and touch. One of them does not.
The name is the spec
Training changes the numbers.
Inference does not.
Partner work first. Then quiet work time.
- No cellphones
- No sleeping
- No non-academic use of Chromebooks
- A quiet room and music
- No interruptions from the teacher
- If you are caught up on this course's work, you may work on anything legitimate for another class