"I Trained a Model" — What Did They Actually Train?
Someone at a dinner party, glass in hand, says "I trained a model recently." The exaggeration in that sentence can run from zero to ninety-nine percent. This page helps you hear what they actually did, and along the way pick up three follow-ups that can quiet the whole table.
In AI, training means changing the model's own parameters, and it costs from hundreds of thousands to over a hundred million yuan. When most people say they "trained a model," they actually wrote a prompt, or attached a knowledge base — that's five minutes versus fifty million.
A large model holds tens of billions to over a trillion parameters. A parameter is just a number; picture them as the dense field of knobs on a mixing board — every bit of what the model can do lives in where those knobs are set.
Training means turning those billions of knobs to the right settings, and the method is almost comically dumb: hide the rest of a sentence and make the model guess the next word. Give it "the weather today is really" and it guesses "purple" when the text said "nice." Wrong — so every knob that fed into that guess gets nudged back a hair. One tiny step, then on to the next sentence, and again. Repeat a few trillion times. When the washing is done, the knob positions have absorbed the fact that "weather" is far more likely to be followed by "nice" than by "purple." That is the entirety of what "learning" means here.
It burns electricity, GPUs, and money — about as expensive as putting a child through twenty years of school. It's a heavy-asset project.
When you tell an AI "you're a senior editor, please polish this," or upload a company document, you haven't touched a single parameter. An analogy: the first is raising a college student from scratch; the second is handing an already-trained graduate a sticky note or a handbook. The sticky note is useful — but you don't get to say you "raised a college student."
So next time you hear "I trained a model," your first reaction can be: did they change any parameters? How many? The ladder below sorts every case into four layers.
From the bottom up, each rung raises the cost and the barrier exponentially. Click a layer to see its time, cost, and barrier. Nine out of ten dinner-party "I trained a model" stories happen on the bottom two rungs.
Rewrite the prompt
Attach a knowledge base (RAG)
Fine-tuning
Pretrain from scratch
A quick quiz: the five lines below are dinner-party classics. Guess which layer each one most likely sits on. Tap an option to reveal the answer.
Can't tell which layer they're on? Don't guess — just ask. These three questions pin down cost, data, and the base model. Anyone who can't answer will slide down a layer on their own.
"How much compute did it cost?"
Training is burned out of real money. L3 starts with renting GPUs; L4 burns tens of millions to over a hundred million. "Training" that can't name a cost range probably never happened.
"How many examples? How many epochs?"
Don't ask where the data came from — a knowledge base and a fine-tune both answer "company docs, business data," so the question tells you nothing. Ask about scale instead: a few hundred documents dropped into a retrieval index is L2; thousands of labeled question-answer pairs run for several epochs is L3. Anyone who can name the example count and the epochs actually moved some parameters.
"What's the base model?"
L1 through L3 all stand on someone else's base. That's nothing to be ashamed of — but it's worth saying clearly. Anyone who hedges with "core tech, can't disclose" can be defaulted to L1.
✅ What this page wants to share with you
- Training = changing model parameters: writing a prompt or attaching a knowledge base doesn't touch parameters; strictly speaking both are "using a model"
- Four-rung ladder: rewrite the prompt, attach a knowledge base, fine-tune, pretrain from scratch — each rung up, the barrier rises exponentially
- When you hear "I trained a model," ask about cost and data first: anyone who can't answer will slide down a layer on their own
- Rewriting the prompt is nothing to be ashamed of: it covers nine out of ten needs. The shame is standing on L1 and claiming L4