What is temperature in a model — the slider between boring and wild

Here's a fun thing. Ask a model the same question ten times. Sometimes you get ten near-identical answers. Sometimes ten different ones, a couple of them pretty wild.

What decides the difference is one tiny setting. It's called temperature.

Think of it as a slider: one end is "boring and predictable," the other is "creative and risky." And you get to move it.

How a model picks words in the first place

First, what's under the hood. Without that, temperature is just a word.

A model writes its answer one piece at a time. At every step it sizes up: what word comes next?

And here's the key bit. It doesn't have one candidate — it has a whole list. To each it silently assigns a weight: this one's very likely, this one so-so, this one a long shot.

Temperature decides how strictly it sticks to the most likely option.

Zero — the straight-A kid who's scared to slip

Set the temperature to zero (or near it).

Now the model almost always grabs the most likely piece. No imagination, no risk. Same question, near-same answer, every time.

It's like a straight-A kid at the board: strictly by the book, not a word extra. Reliable, if a little dull.

But it slips up less. So zero is great where you need accuracy.

Higher up — the poet who loves a gamble

Turn the temperature up and the model gets bolder.

Now it'll sometimes pick not the obvious option but the second or third. Answers get more varied and more alive. Ask twice, get two different texts.

It's like a friend bursting with ideas: half are gold, half miss.

But there's a price. The higher the slider, the more often the model wanders off and may make things up. Push it too far and the text turns to mush.

Which way to turn it for your task

You don't need to memorize numbers. Just keep the slider in mind.

• Facts, code, translation, instructions — turn it down. You want one correct answer here, not ten different ones.
• Ideas, brainstorming, copy, names — turn it up. Variety is a plus here, and a little wildness even helps.
• Not sure — leave it. Models default to the middle, and for most tasks that's plenty.

Many chats don't show this slider directly. But in settings, or through the API, it's often there — look for the word "temperature."

Once it clicks that this is just a "strict vs. imaginative" dial, you stop guessing. Boring answer? Nothing broke — just nudge the slider.