Home/ Sessions/ Text
Session 01 / of 04
Machines that write

Text

When a language model writes, what is it actually doing?

Tokens, prediction, temperature, and the gap between fluent output and understanding. We start unplugged — guessing the next word ourselves — then open the machine and watch it do the same thing, visibly.

forward pass · textlive
inputhiddenhiddennext token

§ A · what we make visible

four mechanisms, one session

Four mechanisms,
one investigation.

01

Tokens

Text is chopped into pieces a model can count — often not where a human would cut.

02

Prediction

The model only ever guesses the next token from what came before.

03

Temperature

One dial slides output from predictable to surprising — and unstable.

04

The illusion

Fluency is easy to mistake for understanding. ELIZA shows why.

§ B · tools for this session

browser-based · no accounts

§ C · run of show

60–90 minutes
0–5

Welcome & norms

Name the question. Remind everyone direct AI use is optional — each person chooses a participation pathway.

5–15

Unplugged prediction game

Show a sentence stem, collect likely next words. Notice how context, genre, and expectation shape guesses.

15–35

Tokenizer + Temperature

Show token chunks, then run one prompt at low and high temperature. Watch probability bars and greedy vs. sampled output.

35–55

ELIZA vs. LLM

Inspect the matched rule, pattern, and template. Compare visible rule-matching with pre-generated LLM examples.

55–75

Investigation

Complete one Text Experiment Board section: a default test, a prompt variation, or an ELIZA comparison.

75–90

Debrief

Reflection frame — human, machine, system, ethics, pedagogy. Share one evidence-based claim and one question.

§ D · discussion prompts

for the debrief
What made your next-word guess feel obvious?
What does the tokenizer split that you wouldn't split as a human reader?
At low temperature, what becomes more predictable?
At high temperature, what becomes more surprising — or unstable?
What does ELIZA make visible that a modern LLM hides?
Where could fluency be mistaken for understanding?

§ E · materials

worksheet & pathways

Low-AI / No-AI pathway

Participants can complete the whole session with only the visualizer, ELIZA, and pre-generated comparison examples — no logging into or prompting a live LLM. Opting out of direct AI use never means opting out of the camp.