Skip to content

Creator checklist

Owner: Content team Scope: Every MVP release candidate must pass or document exceptions.

The creator journey covers: copy a pack → edit persona / goals / rubric → validate → play → export → share → understand content rules.


Terminal window
# From repo root:
python -m pytest tests/acceptance/test_creator_flow.py -v
Test classWhat it verifiesCI label
TestListPacksWorkbench lists official (non-editable) and local-dev (editable) packs[workbench]
TestReadPackContentPack card has pack_id and name; manifest YAML accessible via API[workbench]
TestPackValidationValid pack passes validate_pack_dir; workbench /validate returns valid: true[pack-valid]
TestPackValidationErrorsMissing or malformed manifest produces non-empty error list[pack-valid]
TestPackExportExport produces a zip with a manifest; filename ends in .zip[workbench]
TestPackImportRoundTripImport succeeds; round-trip export preserves pack_id in filename[workbench]

All automated checks must pass before any manual step begins.


Run in the browser creator workbench or via the CLI. A local dev server must be running.

Terminal window
# Option A — workbench UI: Settings → Creator Workbench → Duplicate Pack
# Option B — CLI
cp -r packs/official/job-interview-basic packs/local-dev/my-interview-pack
# edit packs/local-dev/my-interview-pack/manifest.yaml: change pack_id and name
  • Local-dev pack appears in the workbench pack list
  • Pack is marked editable

Open manifest.yaml, scenario YAML, NPC YAML, and rubric YAML in an editor or the workbench file editor.

  • Can modify NPC display_name, speaking_style, and demeanor
  • Can change scenario goals.player_visible list
  • Can add or rename a rubric dimension
  • YAML files save without data loss
Terminal window
node packages/scenario-schema/tests/validate-packs.js packs/local-dev/my-interview-pack

Or via workbench: Validate Pack button.

  • Valid pack exits 0 / shows all green
  • Intentionally broken field produces a clear, actionable error message

Start a session using the edited pack.

  • Custom NPC name appears in the conversation
  • Custom goals appear in the player brief
  • Session plays to completion with fake runtime
Terminal window
# Via API or workbench "Export" button
  • Exported zip contains manifest.yaml (or pack.json) and scenario files
  • Zip can be imported on a fresh install via Settings → Import Pack

Review the safety policy and the official pack quality bar.

  • Creator can articulate the PG-13 content cap rule
  • Creator can describe what nsfw_sexual: block means in the safety policy
  • Creator knows that fictional: true is required on all NPC definitions

ItemResultTesterDateNotes
Automated suitePASS / FAIL
C-M1 Copy packPASS / FAIL / SKIP
C-M2 Edit persona/goals/rubricPASS / FAIL / SKIP
C-M3 ValidatePASS / FAIL / SKIP
C-M4 Play scenarioPASS / FAIL / SKIP
C-M5 Export + sharePASS / FAIL / SKIP
C-M6 Content rulesPASS / FAIL / SKIP

Release decision: All automated checks PASS + manual checks C-M1 through C-M6 PASS (or documented SKIP) required before MVP tag.