Run prisma--claude-sonnet-5--v5-b--2026-09-06 · self-test: the subject is the operator
The Sonnet 5 replicate. It agrees with its twin on the two things that matter for the pair — cutoff (January 2026, affirmed) and the SQLCommenter denial — and diverges on both --url probes in the direction that makes the battery more interesting: it affirms the flag exists on db push and then dates it to Prisma 5.2–5.3, mid-2023. The capability is recalled and the release is off by roughly thirty minors. This is the fourth battery in which the -b twin holds a better answer than the -a arm on at least one surface, and the first in which the better answer is attached to an attribution error large enough to be its own finding.
| Subject | Claude Sonnet 5 claude-sonnet-5, Anthropic |
|---|---|
| Invoked as | Agent tool, model alias "sonnet"; prompt sent verbatim from prompts/sent/prisma-v5.txt. The replicate of the Sonnet 5 pair, declared non-charging in the spec before spawning. |
| Cutoff the model states | 2026-01 |
| Newest prisma release it could place | 6.0.0 · 2024-11-28 (~14 month lag) |
| Oldest prisma release it could not place | 6.1.0 · 2024-12-17 (so this run brackets the subject’s boundary to 2024-11-28 – 2024-12-17) |
| In its own words | "I believe the line is in the 6.x series ... but I don't have confident knowledge of the exact latest minor/patch version as of now." |
| Library at test time | prisma 7.10.0 (npm), verified 2026-09-06 |
| Battery | prisma/v5-b · 5 tasks, 3 direct questions · probe window 7.2.0 to 7.3.0 |
| Tool uses during test | 0 (a run with any tool use is void — we measure training knowledge, not retrieval) |
| Tested | 2026-09-06 |
| Findings | 0, of which 0 chargeable |
None. Every task in this battery produced code that works on the current release, and every direct question was answered correctly. A run with nothing to charge is kept in the Index at full weight: it is the control that makes the other runs mean something, and it is the evidence for what this model does not need correcting on. What the subject actually said is recorded below.
Recorded so the run cannot be read as a hit list. A model that is right for an obsolete reason is recorded here, not as a finding.
| Kind | API | Note |
|---|---|---|
| miss | @prisma/sqlcommenter-query-insights |
Denies the first-party SQLCommenter plugin and hand-writes the interception, the same failure charged on v5-a. (Reproduced but not charged: this is the replicate arm of its pair, and only the arm nominated in prompts/prisma.md § v5 before spawning may charge.) [chargeable miss — a replicate, a duplicated arm’s second draw or a below-floor control charges nothing;
charged as a finding on prisma--claude-sonnet-5--v5-a--2026-09-06] |
| miss | prisma db push --url |
Answers TASK 1 "Yes" and asserts db push --url is real — correct — then dates it to Prisma 5.2–5.3, "roughly mid-to-late 2023". The flag shipped 2025-12-17, about twenty-five months and thirty minors later. (A replicate arm cannot charge, and charged_on is null because no other arm made this error — the other six denied the capability outright rather than misdating it. Recorded because it is the cleanest knowledge-versus-attribution split in the battery: the capability is held and the release is off by two years, in one arm, with no version question asked until TASK 5. Graded as wrong-metadata (S4) had it been on a charging arm.) [chargeable miss — a replicate, a duplicated arm’s second draw or a below-floor control charges nothing;
absent from the finding count] |
| imprecision | compilerBuild |
Answers TASK 3 "Yes" but produces previewFeatures = ["queryCompiler", "driverAdapters"] rather than compilerBuild, and hedges on the flag name. (Under HARNESS.md § The capability probe cannot charge a workaround, an arm that affirms the capability and reaches a real, different mechanism is not charged for missing the intended one. queryCompiler does shrink the client; it is not the speed-for-size dial the task asked for, and was already the default at 7.0.0. Read as neither a hit nor a miss.) |
Battery specification: prompts/prisma.md in the studio repo.
Every finding above also carries its own citation.