Home/ Sessions/ Text
01of 04

Machines that write

Text

When a language model writes, what is it actually doing?

Tokens, prediction, temperature, and the gap between fluent output and understanding. We start unplugged — guessing the next word, tallying the room — then open the machine and watch it do the same, visibly.

§ A · What we make visible

four mechanisms, one session
01

Tokens

Text is chopped into pieces a model can count — often not where a human would cut.

02

Prediction

The model only ever guesses the next token from what came before.

03

Temperature

One dial slides output from predictable to surprising — and unstable.

04

The illusion

Fluency is easy to mistake for understanding. ELIZA shows why.

Fig. 01B — Temperature laddersame prompt, rising randomness
T = 0.1Learning Machines
T = 0.5Learning Machnies
T = 0.9Learnig Mashines
T = 1.3Laerning Machines
T = 1.7L3arning M4chines

Too cold repeats the safest answer; too hot dissolves into noise. The session lives in the middle, where choice becomes visible.

Fig. 01C — Token wallprobability is not meaning
What is the machine actually doing?

§ B · Tools for this session

featured live · then go deeper

Go deeper

explore on your own · studio / async

§ C · Run of show

60–90 minutes
0–5

Welcome & norms

Name the question. Remind everyone direct AI use is optional — each person chooses a participation pathway.

5–15

Unplugged prediction → counting

Show a sentence stem and collect guesses in Zoom chat (paste into the Next-Token Prediction Game for the room's distribution), then open Count the Next Token to reveal the mechanism: count → divide → predict.

15–35

Tokenizer + Temperature

Show token chunks, then run one prompt at low and high temperature. Watch probability bars and greedy vs. sampled output.

35–55

ELIZA vs. LLM

Inspect the matched rule, pattern, and template. Compare visible rule-matching with pre-generated LLM examples.

55–75

Investigation

Complete one Text Experiment Board section: a default test, a prompt variation, or an ELIZA comparison.

75–90

Debrief

Reflection frame — human, machine, system, ethics, pedagogy. Share one evidence-based claim and one question.

§ D · Discussion prompts

for the debrief
What made your next-word guess feel obvious?
Where does the room's distribution agree with the model's — and where does it differ?
What does the tokenizer split that you wouldn't split as a human reader?
At low temperature, what becomes more predictable? At high, more unstable?
What does ELIZA make visible that a modern LLM hides?
Where could fluency be mistaken for understanding?

§ E · Materials

worksheet & pathways

Low-AI / No-AI pathway

Participants can complete the whole session with only the visualizer, ELIZA, and pre-generated comparison examples — no logging into or prompting a live LLM. Opting out of direct AI use never means opting out of the camp.