Do Now · Lab Notebook · 10 minutes

Set up your notebook. You will need it at the end of class.

Terminology and Concepts to look out for

Copy these. Leave space under each one for a definition.

  • parameter
  • pretraining
  • post-training
  • freeze
  • inference
  • knowledge cutoff
Relevance to Me

Think about these. Nothing to write.

  • Next Monday you sit down at a station and type into a model. Today decides what you think is happening on the other end of that.
  • Someone has told you an AI got smarter recently. What did they actually mean?
  • If the numbers never change, what would it even mean for the AI to be yours?
Question of the Day

Copy this into your Lab Notebook and leave room under it. You will answer it at the end of class.

When you send a prompt to an AI model, is the model learning from you?

Before the reading

The words, in plain terms

Six words, and they all serve one line: training is when the numbers change, inference is when they hold still. Nothing today is about hardware.

parameter
One number inside the model.
Something like 0.0412. Pull one out and it tells you nothing. Whatever the model knows is spread across billions of them at once.
In a gameNot a setting in the options menu. Closer to one of the millions of numbers a physics engine multiplies without any of them meaning anything on its own.
The largest model on the rig has roughly twenty seven billion.
pretraining
The long stage where the numbers get nudged, over and over, until they predict text well.
Weeks to months on machines that cost more than most buildings. Nobody writes facts in. The facts are a side effect of getting good at predicting what comes next.
In a gameThe long grind before the game ships, not anything that happens while you play.
post-training
A shorter stage afterwards that shapes how the model answers.
Pretraining decides roughly what it knows. This decides whether it answers in full sentences, follows an instruction, or refuses.
In a gameThe patch that changes how something behaves without rebuilding the game.
freeze
The moment the numbers are written to a file and stop changing.
From here the model does not get smarter, does not get worse, and does not update overnight. It stays what it is until a company runs the whole process again.
In a gameThe moment a build goes gold. After that the disc is the disc.
inference
What happens when you type a prompt: your text goes through the frozen numbers and an answer comes out.
Nothing inside changes while it happens. The numbers you use are bit for bit the same as the ones used by the person before you.
In a gamePlaying the game, as opposed to building it.
knowledge cutoff
The date the text it read stopped.
Ask about anything after it and the model may not know that it does not know, so it produces a confident, well-formed, invented answer.
In a gameThe version the strategy guide was written for. Ask it about a later patch and it answers anyway.
The Day the Numbers Stop Moving

A language model is not a library. It is not a search engine with a friendly voice attached. Underneath the chat window is something much stranger and much simpler: an enormous collection of numbers. Those numbers are called parameters, and the largest model running on the rig in this course holds roughly twenty six billion of them. Not all twenty six billion run on every word, which is a detail worth returning to, but all of them sit in the file. Every answer that model has ever produced came out of those numbers and nothing else.

A parameter is just a number. It is not a sentence, not a fact, not a small file with information in it. If you could reach into the model and pull out a single parameter, you would find something like 0.0412, and it would tell you nothing at all. No parameter holds the idea that Baton Rouge is the capital of Louisiana. That idea, if the model has it, is spread thinly across billions of numbers at once, in a pattern no person could read directly. This is why nobody can open a model and look up what it knows.

So where did those numbers come from? They came from a process called pretraining. During pretraining, the model is shown staggering amounts of text and given one repetitive job: predict what comes next. It guesses, it is wrong, and every time it is wrong the numbers get nudged. Nudge, guess, nudge, guess, billions of times over weeks or months on machines that cost more than most buildings. Nobody sits down and writes facts into the model. The facts arrive as a side effect of getting better at predicting text.

After pretraining comes a second and much shorter stage called post-training. Pretraining decides roughly what the model knows. Post-training decides how it behaves: whether it answers in full sentences, whether it follows an instruction or wanders off, whether it refuses certain requests. This stage is smaller and more targeted, but it is the reason a raw pretrained model and a finished chat model feel like completely different things.

And then, at some point, the adjusting stops.

This is the moment that matters most today. The numbers are written into a file and locked. This is called freezing, and from that moment forward the model is fixed. It does not get smarter. It does not get worse. It does not update itself overnight. Whatever it learned during training is what it has, permanently, until a company decides to run the whole expensive process again and release a different model.

Freezing produces a side effect you have probably run into without having a name for it. The text the model read had to stop somewhere, on some particular date. That date is called the knowledge cutoff. Ask the model about something that happened after its cutoff and it will not know, and worse, it may not know that it does not know. It will produce a confident, well-formed, completely invented answer, because producing well-formed text is exactly the job it was trained for.

Everything that happens after the freeze has its own name: inference. Inference is what occurs when you type a prompt and press enter. Your text is fed through the frozen numbers, and an answer comes out the other side. That is the entire operation. Nothing inside the model changes. The numbers you used are bit for bit identical to the numbers the person before you used and the numbers the person after you will use.

Which brings us back to the question you answered at the start of class. When you send a prompt to a model, is the model learning from you?

No. It cannot. The learning stage ended before the file was ever copied to the machine you are typing on.

The obvious objection is that it certainly feels like it learns. You tell a chatbot your name and three messages later it uses your name. That is real, and it has a boring explanation. The conversation is not stored inside the model. It is stored outside, in ordinary text, and the entire conversation up to that point is quietly resent with every new message. The model reads the whole transcript fresh each time and responds. Close the window and the transcript is gone, and the model is exactly what it was before you arrived.

Hold onto that, because next week you will be using a tool built to make it obvious. It sends your prompt once, to three models at once, with no memory between prompts. No conversation. No follow-ups. One pass through frozen numbers, three times over, so you can see the machinery instead of the illusion.

Work these together
8 questions on the passage. Pick an answer, then check it. Nothing here is collected.
Question 1 of 8the passage
According to the passage, what is a parameter?
Question 2 of 8the passage
The passage says the model’s facts arrive during pretraining. Who wrote them in?
Question 3 of 8the passage
According to the passage, what does post-training decide?
Question 4 of 8the passage
What happens to the numbers at the moment a model is frozen?
Question 5 of 8the passage
The passage says everything after the freeze has its own name. What is it, and what happens during it?
Question 6 of 8the passage
Why can a model be confidently wrong about something that happened last week?
Question 7 of 8the passage
Two students in different periods send the same prompt to the same model. According to the passage, are they using the same numbers?
Question 8 of 8the passage
You tell a chatbot your name and three messages later it uses your name. The passage says the model did not change. So what happened?
Ask

The life of a model

The life of a model numbers changing stops here Pretraining Enormous text in. Predict the next piece, be wrong, adjust. Weeks to months. This is where knowledge comes from. Post- training Shapes how it answers. FREEZE numbers written to a file knowledge cutoff: the reading stopped on a date Inference Prompt in, answer out. Nothing inside changes. Monday Tuesday Wednesday Same numbers all three times. ASK Which arrow in this picture is missing from the right side? REVEAL The one that changes the numbers. After the freeze there is no such arrow. Training changes the numbers. Inference does not.
The life of a model — pretraining and post-training under one arrow labelled numbers changing, and that arrow stops at the freeze. Everything to the right of the freeze is inference.
Reveal

The life of a model

The life of a model numbers changing stops here Pretraining Enormous text in. Predict the next piece, be wrong, adjust. Weeks to months. This is where knowledge comes from. Post- training Shapes how it answers. FREEZE numbers written to a file knowledge cutoff: the reading stopped on a date Inference Prompt in, answer out. Nothing inside changes. Monday Tuesday Wednesday Same numbers all three times. ASK Which arrow in this picture is missing from the right side? REVEAL The one that changes the numbers. After the freeze there is no such arrow. Training changes the numbers. Inference does not.
The life of a model — pretraining and post-training under one arrow labelled numbers changing, and that arrow stops at the freeze. Everything to the right of the freeze is inference.
Four stages, one question

Do the numbers change?

Four Stages, One Question
StageWhat happensHow longDo the numbers change?
PretrainingThe model reads enormous amounts of text and guesses what comes next. Every wrong guess nudges the numbers.Weeks to monthsYes. Constantly. This is where knowledge comes from.
Post-trainingA smaller, targeted stage. Teaches the model to follow instructions, answer in full sentences, and refuse some requests.Days to weeksYes, but far fewer of them, and aimed at behavior instead of knowledge.
FreezingThe numbers are written into a file and locked. The file gets copied to servers and to machines like the one in Mr. Muggivan’s house.A momentNo. This is the moment it stops.
InferenceYou type a prompt. It runs through the frozen numbers. An answer comes out.SecondsNo. Not once. Not ever.

Two things follow from the bottom two rows. The model has a knowledge cutoff, because the reading stopped on a date. The model is not learning from you, because the learning was over before the file reached the machine you are typing on.

Ask

What a parameter is, and where it lives

What a parameter is, and where it lives A parameter is not any of these: a sentence a fact a file It is one number. This one: 0.0412 Not a special number. One of 26 billion like it. Where that number lives, from the outside in: The whole model Layers stacked on layers One layer Numbers in, numbers out one input one output One connection Joins one to one 0.0412 The parameter It sits on the connection No single parameter holds "Baton Rouge is the capital of Louisiana." That fact is spread across billions of them at once. ASK If you opened the model file and read one number, could you tell what it knows? REVEAL No. One number means nothing alone. Knowledge is the pattern across all of them, and the pattern only shows up when you do the arithmetic.
What a parameter is, and where it lives — the model file zoomed down to one number. A parameter is not a sentence, not a fact, not a file. It is a number.
Reveal

What a parameter is, and where it lives

What a parameter is, and where it lives A parameter is not any of these: a sentence a fact a file It is one number. This one: 0.0412 Not a special number. One of 26 billion like it. Where that number lives, from the outside in: The whole model Layers stacked on layers One layer Numbers in, numbers out one input one output One connection Joins one to one 0.0412 The parameter It sits on the connection No single parameter holds "Baton Rouge is the capital of Louisiana." That fact is spread across billions of them at once. ASK If you opened the model file and read one number, could you tell what it knows? REVEAL No. One number means nothing alone. Knowledge is the pattern across all of them, and the pattern only shows up when you do the arithmetic.
What a parameter is, and where it lives — the model file zoomed down to one number. A parameter is not a sentence, not a fact, not a file. It is a number.
Ask

The arithmetic

The arithmetic Multiply, add, squeeze. That is the entire operation. It just happens a lot. 1 One connection does one multiplication. 0.8 x 0.0412 = 0.033 the input the parameter what gets through The parameter decides how much of the input survives. Big parameter, most of it. Tiny parameter, almost none of it. 2 Add up every connection feeding the same spot. Then squeeze it. 0.033 + 0.019 + 0.104 + ... = 2.41 -> squeeze -> 0.91 Squeezing keeps numbers from running away to infinity. That is all it is for. That 0.91 is now an input number for the next layer, and the whole thing repeats. 3 Do that billions of times, through every layer. For one word. Nothing gets looked up. Nothing gets searched. It is multiply, add, squeeze, over and over, at a speed you cannot picture. 4 The last layer gives every word a score. Highest score wins. The Cat in the ___ Every word the model knows gets a number. Tens of thousands of them. ASK What word is coming? Say it out loud. hat 9.2 winner box 3.1 house 2.8 purple 0.0 "hat" is the next word. Nobody stored that answer anywhere. The numbers got nudged toward it during pretraining, because that phrase turned up over and over in what the model read. Now "hat" gets added and the whole thing runs again. A response is not written. It is one word at a time, arithmetic all the way down.
The arithmetic — four numbered steps from a prompt to one predicted word. Multiply, add, squeeze, score. A response is not written; it is one word at a time.
Reveal

The arithmetic

The arithmetic Multiply, add, squeeze. That is the entire operation. It just happens a lot. 1 One connection does one multiplication. 0.8 x 0.0412 = 0.033 the input the parameter what gets through The parameter decides how much of the input survives. Big parameter, most of it. Tiny parameter, almost none of it. 2 Add up every connection feeding the same spot. Then squeeze it. 0.033 + 0.019 + 0.104 + ... = 2.41 -> squeeze -> 0.91 Squeezing keeps numbers from running away to infinity. That is all it is for. That 0.91 is now an input number for the next layer, and the whole thing repeats. 3 Do that billions of times, through every layer. For one word. Nothing gets looked up. Nothing gets searched. It is multiply, add, squeeze, over and over, at a speed you cannot picture. 4 The last layer gives every word a score. Highest score wins. The Cat in the ___ Every word the model knows gets a number. Tens of thousands of them. ASK What word is coming? Say it out loud. hat 9.2 winner box 3.1 house 2.8 purple 0.0 "hat" is the next word. Nobody stored that answer anywhere. The numbers got nudged toward it during pretraining, because that phrase turned up over and over in what the model read. Now "hat" gets added and the whole thing runs again. A response is not written. It is one word at a time, arithmetic all the way down.
The arithmetic — four numbered steps from a prompt to one predicted word. Multiply, add, squeeze, score. A response is not written; it is one word at a time.
Real quantities

Our numbers, not a textbook’s.

Three Models, Real Numbers
ModelTotal parametersActive per tokenFile size at Q4Where it runsKnowledge cutoff
Gemma 4 E4B8,000,000,0004,500,000,000 effective6.33 GBMr. Muggivan’s rigJanuary 2025
Gemma 4 26B-A4B26,000,000,0004,000,000,00018.2 GBMr. Muggivan’s rigJanuary 2025
Gemini 3.7 FlashNot publishedNot publishedNot publishedGoogle’s serversMarch 2026

These are the three models you will use on Monday. Two of them sit on a machine you could walk up to and touch. One of them does not.

The name is the spec

The name is the spec This is the actual file sitting on the machine. Nothing here is decoration. gemma-4-26B-A4B-it-qat-q4_0.gguf gemma the family Google's open models 4 the generation not the size 26B 26 billion parameters in the file A4B 4 billion of them actually run on each word it instruction tuned this is the post-training qat not today q4_0 not today .gguf the file format how the numbers are packed Six of these eight you already know, and you learned four of them today. The two dotted boxes are the next thing. Write them down. We come back to them. Both are about how much space each number is allowed to take up.
The name is the spec — the real filename off the rig, cut into eight labelled parts. Six of the eight are things today already covered. Two are drawn dotted and marked not today.

Training changes the numbers.
Inference does not.

The rest of the block

Partner work first. Then quiet work time.

The three rules
  • No cellphones
  • No sleeping
  • No non-academic use of Chromebooks
What you get
  • A quiet room and music
  • No interruptions from the teacher
  • If you are caught up on this course's work, you may work on anything legitimate for another class
If you are picking, pick reading or writing.
Everything we build in this class, we build with words. The tools take writing as input. How well you write is the ceiling on what you can make them do.
Open this now: muggsofcompsci.net/decks/cs1-stack-day5-wedo