Agora · Scenarios

1,000 made-up scenarios, checked against the same rules

We generated situations, methods, people, and stakeholders, and checked each combination against the written rules the queue uses: files that must stay local, a second distinct checker, and time limits. Nothing here is a real nonprofit request, and zero model calls were made. Anyone can re-run it from seed 20261031.

1,000 scenarios evaluated
sampled from 10¹² combinations
written rules, zero model calls
seed 20261031
checked locally

Why scenarios were blocked

A scenario can be blocked for more than one reason: 470 recorded reasons across 325 blocked scenarios.

Needed the cloud, but the work had to stay offline165
cloud_tier_cannot_run_in_offline_airgap
Mixed private and public data, not split97
mixed_or_regulated_data_missing_private_public_split
Sensitive data would have left the building85
unsplit_cloud_egress_on_high_pii_data
Too slow for the situation50
method_latency_exceeds_operator_or_situational_budget
No second, different checker42
missing_distinct_reviewer_two_step_gate
A stakeholder vetoed cloud use for sensitive data31
stakeholder_veto_cloud_on_high_pii_airgap

Who objected most

Share of their 100 scenarios each stakeholder blocked.

Skeptical municipal funder36%
Impacted community advocate36%
Privacy and HIPAA counsel35%
Volunteer agent donor35%
Frontline caseworker34%
Clinical research coordinator33%
Nonprofit treasurer32%
Security reviewer31%
Public records journalist29%
Disability access auditor24%

25 kinds of work, 40 scenarios each

Approved as asked
Approved after a private/public split
Blocked

Showing 25 of 25 kinds of work.

Kind of work	As asked	Split	Blocked
Rural shelter offline handwritten intake transcription	5	20	15
Multilingual disaster relief voucher and escrow verification	7	22	11
Municipal and state enacted budget appropriation line audit	4	22	14
Clinical trial adverse-event and subgroup table extraction	4	22	14
Supply-chain timecard and piece-rate wage discrepancy triage	6	21	13
Food bank perishable cold-chain inventory and pickup scheduling	10	15	15
Housing court public docket and notice-period verification	7	22	11
Public benefits portal WCAG 2.2 AA accessibility audit	7	20	13
Regional smoke sensors and school clean-air shelter readiness	9	19	12
Foreign vocational syllabus and licensing hour mapping	6	21	13
Service-line material records and lead pipe inventory	3	24	13
Nonprofit grant renewal outcome and receipt reconciliation	2	27	11
Made-up elder-fraud message patterns for helpline training	6	19	15
Rural accessible dial-a-ride and dialysis van scheduling	5	24	11
Civic software SBOM reachability and license scan	4	25	11
Public-health video dwell and caption legibility audit	6	22	12
Post-cutoff SDK specs compiled into holdout-disjoint LoRA pairs	5	22	13
Untrusted retrieval sanitization and context packing	10	20	10
Work-queue lease expiry and fencing-token audit	8	20	12
Cross-harness cost, latency and patch-pass comparison	9	13	18
Purged walk-forward regime validation	4	26	10
Smallholder cooperative pest and weather bulletins	5	19	16
Hearing transcript witness-statement cross-reference index	7	18	15
Low-income community solar interconnection audit	6	20	14
Perinatal Medicaid-accepting clinic directory refresh	6	21	13

Three scenarios, start to finish

✓ Approved as asked
ENV-0004 · METH-0116 · PERS-0766 · STKH-0237
Rural shelter intake transcription, checked locally with a paired holdout. The rules allowed it as described.
Became: a task object for checking transcriptions against held-out samples.
Stays with a person: crisis follow-up, bed allocation, and intake sign-off.
⇄ Approved after a split
ENV-0003 · METH-0262 · PERS-0050 · STKH-0130
Intake work paired with public resource research. Handwritten statements stayed on the shelter’s computer; public budget lines went to volunteers.
Became: a task object for the two-step check by a distinct reviewer.
Stays with a person: crisis follow-up, bed allocation, and intake sign-off.
✕ Blocked
ENV-0001 · METH-0831 · PERS-0178 · STKH-0395
Asked a cloud model to read sensitive statements in an offline setting. Two rules stopped it before any work could queue.
Became: a guardrail: sensitive files never go to a cloud tier unsplit.
Stays with a person: crisis follow-up, bed allocation, and intake sign-off.

Re-run it deterministically with the meta-are-scenario-matrix seed pack (seed 20261031), inspired by Meta’s Agents Research Environments (Gaia2) and Matrix. meta-are-scenario-matrix pack →

Digest: scenario_matrix_1000_digest.json · SHA-256 f99b3becdcffd84ff6228eedb2b0f789d65ea9ce30e4103f51c387a0ee69616d