Home/ Materials/ Pilot Checklist

Pilot Checklist

Use this checklist for a 60-90 minute live pilot using the published GitHub Pages site.

Before the Session

  • Open the live site: https://saberkhan372.github.io/learning-machines-tools/
  • Open the relevant session script in a separate tab.
  • Open the worksheet participants will use.
  • Run through the tool controls once as facilitator.
  • Confirm the participation pathways are visible:
    • Use
    • Observe / Critique
    • Teach / Design
    • Build / Code
    • Critical / No-AI
  • Confirm public-sharing consent before collecting screenshots, examples, names, or comments.

During the Session

  • Start with the repeated question: “What is the machine actually doing?”
  • Name direct AI use as optional.
  • Keep notes on:
    • confusing labels,
    • controls participants miss,
    • concepts that click,
    • moments of discomfort,
    • bugs or layout issues,
    • comments worth following up on.
  • Capture screenshots only when consent is clear.
  • Mark any issue as one of:
    • launch blocker,
    • pilot caveat,
    • later polish,
    • second-wave idea.

After the Session

  • Ask participants to complete the Pilot Feedback Form.
  • Save facilitator notes in one place.
  • List top three tool issues.
  • List top three concept-clarity issues.
  • List any consent, attribution, or recap concerns.
  • Decide whether each issue belongs in:
    • immediate fix,
    • documentation note,
    • future cohort,
    • second-wave tool.

Evidence to Collect

  • Which tool was used.
  • Which prompt, setting, or drawing task was tested.
  • What changed across versions or frames.
  • What participants noticed.
  • What the machine/system appeared to assume.
  • What ethical or classroom concern appeared.
  • Optional: export an A/B/C Comparison Board as Markdown or JSON when a group produces a useful text, image, or video investigation.

Before anything goes in a public recap, confirm:

  • May this participant’s name be used?
  • Should a display name or initials be used instead?
  • May their comments be quoted or summarized?
  • May their project or worksheet be mentioned?
  • May screenshots, clips, or outputs be shown?
  • Are there students, communities, real people, or private contexts that should be removed?