Before any live pilot, Eli replays a school's historical cases with no live effect and compares its disposition to the office's. Every product gate has to pass. Procurement, security, contract, identity, and data access are separate gates. This run covers 183 synthetic cases (modeled pilot volume: 400).
Bring one workflow and one de-identified case. No data leaves your office for this meeting.
We walk the workflow the way your office runs it: seven questions in 45 minutes. By the end we reproduce a result you already know and show the defense file behind it. That earns data access.
What exact event, file, or report tells you there is work? Who notices first? What can be missed?
How do you find every affected record? Which date starts which deadline? What report proves completeness?
The real SIS screens, portals, spreadsheets, and federal sites. Which one is authoritative at each stage?
One real de-identified case, first event to final close: every click, handoff, wait, calculation, and message.
The three cases that consume disproportionate time. What missing or conflicting fact stops the work? Who decides?
What is posted or transmitted? How do you know it was accepted? Which financial and system records must tie?
A different staff member reconstructs the case. What evidence is hard to find? What relies on memory?
Modeled on the cohort's per-case economics, no live effect
Security review starts with the model card, data-handling controls, RLS, retention schedule, and the mode-boundary memo. The artifacts procurement and IT ask for.
A de-identified historical cohort (300 to 500 cases) loads into a scoped tenant. Identifiers are masked. The distribution that makes the queue realistic is kept.
Eli replays the cohort with no live effect. Every disposition is compared to the office's own decision. The gates below decide whether to advance.
Starts only after the gates pass. Eli prepares real cases and your staff approve every call. Straight-through clearing stays off until the office says so.
Seven dimensions, agreed before any data moves and measured at exit
Inclusion and exclusion rules, with control totals
Your report counts and dollars match Eli's import
Golden cases and the acceptable tolerance
Every intermediate value and final result agree
Named unsupported and ambiguous scenarios
Each routes to the right owner, with no false confidence
Required human gates and downstream states
Approval, exported action, response, and reconciliation on record
Baseline touches and cycle time, with a target
Measured before and after on the same cohort
Eli's disposition vs the office's historical decision (183 cases replayed)
| Case | Office did | Eli would | Agreement | Audit packet |
|---|---|---|---|---|
| Olivia Lim | Request docs | Route to human | documented diff | complete |
| Dmitri Costa | Route to human | Route to human | match | complete |
| Kofi Hernández | Route to human | Route to human | match | complete |
| Fatima Noor | Route to human | Route to human | match | complete |
| Rosa Martinez |
Optional. Eli's team works the queue on the same software. Your office keeps the sign-off.
Required audit-packet contents
A blind reviewer reproduces the decision
De-identification, retention, access, and deletion
A signed handling protocol and a purge report
| Dimension | Agreed up front | Evidence at exit |
|---|---|---|
| Population | Inclusion and exclusion rules, with control totals | Your report counts and dollars match Eli's import |
| Correctness | Golden cases and the acceptable tolerance | Every intermediate value and final result agree |
| Exceptions | Named unsupported and ambiguous scenarios | Each routes to the right owner, with no false confidence |
| Workflow | Required human gates and downstream states | Approval, exported action, response, and reconciliation on record |
| Efficiency | Baseline touches and cycle time, with a target | Measured before and after on the same cohort |
| Defense | Required audit-packet contents | A blind reviewer reproduces the decision |
| Data boundary | De-identification, retention, access, and deletion | A signed handling protocol and a purge report |
| Route to human |
| Route to human |
| match |
| complete |
| Marcus Lee | Correct | Route to human | documented diff | complete |
| Liang Romano | Route to human | Route to human | match | complete |
| Bryce Whitaker | Clear | Route to human | documented diff | complete |
| Tyrone Williams | Route to human | Route to human | match | complete |
| Aisha Bello | Route to human | Route to human | match | complete |
| Nadia Washington | Route to human | Route to human | match | complete |
| Andrés Cohen | Route to human | Route to human | match | complete |