Home/ Tool index/ Default Test Comparison Viewer
Launch ready Session 2 · Images Interactive

Default Test Comparison Viewer

A vague prompt is a question to the training data. Compare vague, specific, and critically-revised prompts side by side to see what the model assumed when you didn't say.

tools/default-test-comparison-viewer/

Live preview · launch for the interactive version

§ A · What it makes visible

three hidden mechanisms
Fig. 01

The vague prompt

See what a one-word prompt returns — the model's safest, most common guess.

Fig. 02

The specific prompt

Add detail and watch which assumptions get overridden, and which persist.

Fig. 03

The revision

A critical rewrite surfaces what the default left out, and who it left out.

§ B · How to investigate it

run it like an experiment, not a toy
01 · Predict

Before the comparison

Predict the default for a vague prompt like 'a doctor' or 'a home.'

guess: the common stereotype
02 · Change one thing

Add one descriptor

Hold the subject; add a single specifying word.

'a doctor' → 'a rural doctor'
03 · Compare evidence

Read the three panels

What changed, what stayed, what only a rewrite fixed?

default persists until named
04 · Name it

Name the assumption

Say what the model assumed and where that assumption came from.

default = data's majority

§ C · Debrief questions

after the investigation
What did the vague prompt assume about the world?
Which assumptions survived a more specific prompt?
Whose representation depended on you asking explicitly?
When is a default a convenience, and when is it a harm?

§ D · Related

pairs well with · use in context