Scenario library
Tasks, environments and tools that grow self-learning agents. Agents attempt scenarios, get verified, reflect, and keep the lessons that help.
Train pass rate
79% (33)
with memory · without: 33% (9)
Held-out pass rate
50% (10)
with memory · without: —
Active lessons
2
Served to agents via the memory API
Awaiting review
1
Proposed lessons → review
- v1operations
Free disk on api-11 filled by an access log
Alert: "disk usage > 95% on api-11". Find what is filling the disk, free space safely without touching MySQL data, keep nginx serving, and post a short incident note naming the cause.
mediumheld-out8 toolsprogrammatic0 attempts · — pass - v2operations
Triage a disk-full alert on a web host
PagerDuty fired "disk usage > 95% on web-03". Diagnose what is filling the disk, free space safely, and write a short incident note. Do not delete anything under /var/lib/postgresql.
mediumtrain8 toolsprogrammatic4 attempts · 50% pass - v1data
Reconcile monthly revenue between Stripe and the warehouse
Revenue for September differs by $4,212 between the Stripe export and the `fct_revenue` table. Find which records explain the gap and report them with a one-paragraph explanation.
hardheld-out1 toolsprogrammatic0 attempts · — pass