todo-app-scaffolded · pi-gemini-3.8-flash
pi · started 2026-10-07T15:14:01.763Z · horizon 480s · judge ai (anthropic:claude-sonnet-5), 2 frames scored
Area under curve
0.860
headline, 0-1
Tab title/icon
1m 10s
browser chrome, not the page
First render
1m 7s
anything on screen
First reviewable
1m 7s
worth feedback
Final score
1.00
no regression
Correctness over time
Where the time went
99%
Model thinking 1m 24sTool round trips 0.0sUnaccounted 0.9s
| Phase | Time | Share | Side |
|---|---|---|---|
| Model thinking | 1m 24s | 98.9% | agent |
| Tool round trips | 0.0s | 0.0% | agent |
| Dependency install | 0.0s | 0.0% | toolchain |
| Build | 0.0s | 0.0% | toolchain |
| Dev server boot | 0.0s | 0.0% | toolchain |
| First paint | 0.0s | 0.0% | toolchain |
| Unaccounted | 0.9s | 1.0% | unknown |
| Wall clock (cold start) | 1m 25s | 100% |
Agent or toolchain
99%
Agent (model + tool round trips) 1m 24s
Toolchain (install + build + boot + paint) 0.0s
Unaccounted 0.9s
Accounted for: 99.0% of wall clock.
- Excludes 15.0s of deliberate idle observation (settle window); the curve still covers it.
Iteration: prompt to visible change
Follow-ups were injected into the same live session.
| Edit | First visible change | Correct change | Agent done | Tool calls | After agent | Broken for |
|---|---|---|---|---|---|---|
| Make the header background blue. | 20.8s | 20.8s | 26.8s | 1 (edit) | -6.0s | -- |
| Add a fourth column called "Blocked" after Done. | 21.3s | 21.3s | 25.9s | 7 (read, edit) | -4.5s | -- |
Judged frames
All criteria met: polished board with columns, cards, badges, assignees, and add button.
All criteria met: polished light-themed board with columns, styled cards, and header.
Caveats
- judge: anthropic:claude-sonnet-5 does not accept a sampling temperature, so these frames were scored at the provider's default rather than at 0. Two runs of the same page can be scored differently, and that variance is inside the AUC. result.json records the temperature as null rather than as the value that was asked for, so p2p compare will not pool this run with one that was scored at a fixed temperature.