{"run":"r00","kind":"reference","date":"2026-10-07T22:26:43Z","outcome":"finished","spec_tag":"spec-v1.0.0","spec_blob":"964bb66d837bb15047a067a0b349c32cf0cd4613","decisions_blob":"7785c6dc9c5716e55b125275fb4aa5ece568e0ec","suite_tree":"9f28d4f3efa0332bfea189e7ce28620b96424712","platform":"linux","node":"v22.22.0","reference":"RobotRegistryFoundation/rcan-spec@16fc1a4a829426d43b200db4d8e65537810f2e6b (scripts/assurance/evidence-chain.ts by type stripping; schemas/envelope.json with ajv 8.20.0)","adapter":".regenerate/suite/adapters/reference","flags":"--reference","suite":{"passed":378,"total":422,"advisory":"0/0","skipped":0,"na":30,"failing":[{"case":"shape-seq-negative","reqs":["REQ-CH-001"],"class":"c:D-009"},{"case":"shape-seq-fraction","reqs":["REQ-CH-001"],"class":"c:D-009"},{"case":"shape-seq-string","reqs":["REQ-CH-001"],"class":"c:D-009"},{"case":"shape-seq-bool","reqs":["REQ-CH-001"],"class":"c:D-009"},{"case":"shape-seq-missing","reqs":["REQ-CH-001"],"class":"c:D-009"},{"case":"shape-prev-missing","reqs":["REQ-CH-001"],"class":"c:D-009"},{"case":"shape-hash-number","reqs":["REQ-CH-001"],"class":"c:D-009"},{"case":"shape-record-not-object","reqs":["REQ-CH-001"],"class":"c:D-009"},{"case":"shape-audit-seq-missing","reqs":["REQ-CH-001"],"class":"c:D-009"},{"case":"shape-replay-record-array","reqs":["REQ-CH-001"],"class":"c:D-009"},{"case":"cj-overflow","reqs":["REQ-CJ-004"],"class":"c:D-005"},{"case":"cj-overflow-neg-nested","reqs":["REQ-CJ-004"],"class":"c:D-005"},{"case":"cj-overflow-key-order","reqs":["REQ-CJ-004"],"class":"c:D-005"},{"case":"cj-lone-high","reqs":["REQ-CJ-005"],"class":"c:D-006"},{"case":"cj-lone-low","reqs":["REQ-CJ-005"],"class":"c:D-006"},{"case":"cj-reversed-pair","reqs":["REQ-CJ-005"],"class":"c:D-006"},{"case":"cj-lone-in-key","reqs":["REQ-CJ-005"],"class":"c:D-006"},{"case":"cj-lone-nested","reqs":["REQ-CJ-005"],"class":"c:D-006"},{"case":"ha-envelope-overflow","reqs":["REQ-HA-002","REQ-CJ-004"],"class":"c:D-005"},{"case":"ha-record-lone","reqs":["REQ-HA-003","REQ-CJ-005"],"class":"c:D-006"},{"case":"ch-record-overflow","reqs":["REQ-CH-002","REQ-CJ-004"],"class":"c:D-005"},{"case":"aa-no-authority-number","reqs":["REQ-AA-002"],"class":"c:D-011"},{"case":"aa-principal-true","reqs":["REQ-AA-002"],"class":"c:D-011"},{"case":"rp-speed-string-unchecked-bound","reqs":["REQ-RP-001"],"class":"b:D-014"},{"case":"rp-bound-not-number","reqs":["REQ-RP-002"],"class":"c:D-017"},{"case":"rp-keep-out-skips-non-polygon","reqs":["REQ-RP-002"],"class":"c:D-017"},{"case":"rp-keep-in-not-polygon","reqs":["REQ-RP-002"],"class":"c:D-017"},{"case":"rp-target-not-point","reqs":["REQ-RP-001"],"class":"c:D-017"},{"case":"rp-stop-ignores-bounds","reqs":["REQ-RP-001"],"class":"b:D-014"},{"case":"rp-applied-not-object","reqs":["REQ-RP-001"],"class":"b:D-012"},{"case":"rp-allow-modified","reqs":["REQ-RP-001"],"class":"b:D-012"},{"case":"rp-allow-cmd-missing","reqs":["REQ-RP-001"],"class":"b:D-012"},{"case":"rp-allow-extra-applied","reqs":["REQ-RP-001","REQ-RP-004"],"class":"b:D-012"},{"case":"rp-allow-bool-vs-number","reqs":["REQ-RP-001","REQ-RP-004"],"class":"b:D-012"},{"case":"rp-unchecked-wrong-type","reqs":["REQ-RP-004"],"class":"b:D-014"},{"case":"rp-unchecked-utf16-order","reqs":["REQ-RP-004"],"class":"b:D-014"},{"case":"rp-missing-reason","reqs":["REQ-RP-001"],"class":"b:D-012"},{"case":"rp-unknown-decision","reqs":["REQ-RP-001"],"class":"b:D-012"},{"case":"rp-unchecked-fields","reqs":["REQ-RP-004"],"class":"b:D-014"},{"case":"rp-unchecked-not-from-reject-or-nonobject","reqs":["REQ-RP-004"],"class":"b:D-012"},{"case":"rp-order-in-record","reqs":["REQ-RP-001"],"class":"b:D-012"},{"case":"rp-order-allow-full","reqs":["REQ-RP-001"],"class":"b:D-012"},{"case":"rp-envelope-overflow","reqs":["REQ-RP-001","REQ-CJ-004"],"class":"c:D-005"},{"case":"rp-records-many","reqs":["REQ-RP-001","REQ-RP-004"],"class":"b:D-012"}]},"notes":"All 44 failures explained: b:D-012 11, b:D-014 5, c:D-005 6, c:D-006 6, c:D-009 10, c:D-011 2, c:D-017 4. validateEnvelope compared on valid only. 30 n/a: 3 static checks, 27 command-line cases that need --json or exit statuses 2 and 3."}
{"run":"r00-port","kind":"reference","date":"2026-10-07T22:26:43Z","outcome":"finished","spec_tag":"spec-v1.0.0","spec_blob":"964bb66d837bb15047a067a0b349c32cf0cd4613","decisions_blob":"7785c6dc9c5716e55b125275fb4aa5ece568e0ec","suite_tree":"9f28d4f3efa0332bfea189e7ce28620b96424712","platform":"linux","node":"v22.22.0","reference":"RobotRegistryFoundation/rcan-py@0184314e8da18ef348d2120e2087ad97d8edcaeb (rcan/assurance.py, the SDK's Python port of the reference verifier; Python 3.13.16)","adapter":".regenerate/suite/adapters/port-py","flags":"--reference --na validateEnvelope,cli,if-regen","suite":{"passed":210,"total":265,"advisory":"0/0","skipped":0,"na":187,"failing":[{"case":"shape-seq-negative","reqs":["REQ-CH-001"],"class":"c:D-009"},{"case":"shape-seq-fraction","reqs":["REQ-CH-001"],"class":"c:D-009"},{"case":"shape-seq-string","reqs":["REQ-CH-001"],"class":"c:D-009"},{"case":"shape-seq-bool","reqs":["REQ-CH-001"],"class":"c:D-009"},{"case":"shape-seq-missing","reqs":["REQ-CH-001"],"class":"c:D-009"},{"case":"shape-prev-missing","reqs":["REQ-CH-001"],"class":"c:D-009"},{"case":"shape-hash-number","reqs":["REQ-CH-001"],"class":"c:D-009"},{"case":"shape-record-not-object","reqs":["REQ-CH-001"],"class":"c:D-009"},{"case":"shape-audit-seq-missing","reqs":["REQ-CH-001"],"class":"c:D-009"},{"case":"shape-replay-record-array","reqs":["REQ-CH-001"],"class":"c:D-009"},{"case":"cj-utf16-order","reqs":["REQ-CJ-001"],"class":"c:D-003"},{"case":"cj-utf16-order-nested","reqs":["REQ-CJ-001"],"class":"c:D-003"},{"case":"cj-num-07","reqs":["REQ-CJ-003"],"class":"c:D-004"},{"case":"cj-num-10","reqs":["REQ-CJ-003"],"class":"c:D-004"},{"case":"cj-num-12","reqs":["REQ-CJ-003"],"class":"c:D-004"},{"case":"cj-num-13","reqs":["REQ-CJ-003"],"class":"c:D-004"},{"case":"cj-num-14","reqs":["REQ-CJ-003"],"class":"c:D-004"},{"case":"cj-num-15","reqs":["REQ-CJ-003"],"class":"c:D-004"},{"case":"cj-num-19","reqs":["REQ-CJ-003"],"class":"c:D-004"},{"case":"cj-num-20","reqs":["REQ-CJ-003"],"class":"c:D-004"},{"case":"cj-num-22","reqs":["REQ-CJ-003"],"class":"c:D-004"},{"case":"cj-num-25","reqs":["REQ-CJ-003"],"class":"c:D-004"},{"case":"cj-num-33","reqs":["REQ-CJ-003"],"class":"c:D-004"},{"case":"cj-num-34","reqs":["REQ-CJ-003"],"class":"c:D-004"},{"case":"cj-num-35","reqs":["REQ-CJ-003"],"class":"c:D-004"},{"case":"cj-num-in-object","reqs":["REQ-CJ-003"],"class":"c:D-004"},{"case":"cj-overflow","reqs":["REQ-CJ-004"],"class":"c:D-005"},{"case":"cj-overflow-neg-nested","reqs":["REQ-CJ-004"],"class":"c:D-005"},{"case":"cj-overflow-key-order","reqs":["REQ-CJ-004"],"class":"c:D-005"},{"case":"ha-envelope-overflow","reqs":["REQ-HA-002","REQ-CJ-004"],"class":"c:D-005"},{"case":"ch-record-overflow","reqs":["REQ-CH-002","REQ-CJ-004"],"class":"c:D-005"},{"case":"aa-no-authority-number","reqs":["REQ-AA-002"],"class":"c:D-011"},{"case":"aa-principal-true","reqs":["REQ-AA-002"],"class":"c:D-011"},{"case":"aa-authority-not-object","reqs":["REQ-AA-001"],"class":"c:REQ-AA-001"},{"case":"rp-speed-string-unchecked-bound","reqs":["REQ-RP-001"],"class":"b:D-014"},{"case":"rp-keep-out-skips-non-polygon","reqs":["REQ-RP-002"],"class":"c:D-017"},{"case":"rp-keep-in-not-polygon","reqs":["REQ-RP-002"],"class":"c:D-017"},{"case":"rp-target-not-point","reqs":["REQ-RP-001"],"class":"c:D-017"},{"case":"rp-stop-ignores-bounds","reqs":["REQ-RP-001"],"class":"b:D-014"},{"case":"rp-reject-applied-missing","reqs":["REQ-RP-001"],"class":"c:D-018"},{"case":"rp-applied-not-object","reqs":["REQ-RP-001"],"class":"b:D-012"},{"case":"rp-allow-modified","reqs":["REQ-RP-001"],"class":"b:D-012"},{"case":"rp-allow-cmd-missing","reqs":["REQ-RP-001"],"class":"b:D-012"},{"case":"rp-allow-extra-applied","reqs":["REQ-RP-001","REQ-RP-004"],"class":"b:D-012"},{"case":"rp-allow-bool-vs-number","reqs":["REQ-RP-001","REQ-RP-004"],"class":"b:D-012"},{"case":"rp-unchecked-wrong-type","reqs":["REQ-RP-004"],"class":"b:D-014"},{"case":"rp-unchecked-utf16-order","reqs":["REQ-RP-004"],"class":"b:D-014"},{"case":"rp-missing-reason","reqs":["REQ-RP-001"],"class":"b:D-012"},{"case":"rp-unknown-decision","reqs":["REQ-RP-001"],"class":"b:D-012"},{"case":"rp-unchecked-fields","reqs":["REQ-RP-004"],"class":"b:D-014"},{"case":"rp-unchecked-not-from-reject-or-nonobject","reqs":["REQ-RP-004"],"class":"b:D-012"},{"case":"rp-order-in-record","reqs":["REQ-RP-001"],"class":"b:D-012"},{"case":"rp-order-allow-full","reqs":["REQ-RP-001"],"class":"b:D-012"},{"case":"rp-envelope-overflow","reqs":["REQ-RP-001","REQ-CJ-004"],"class":"c:D-005"},{"case":"rp-records-many","reqs":["REQ-RP-001","REQ-RP-004"],"class":"b:D-012"}]},"notes":"Comparison subject, not the reference. On the 265 cases both ran, its pass/fail differs from the reference on 25: it fails 18 the reference passes (key order 2, number text 14, a crash on a non-object authority 1, an absent applied on reject 1) and passes 7 the reference fails (6 lone surrogates, 1 bound type)."}
{"run":"r00-sdk-ts","kind":"reference","date":"2026-10-07T22:26:43Z","outcome":"finished","spec_tag":"spec-v1.0.0","spec_blob":"964bb66d837bb15047a067a0b349c32cf0cd4613","decisions_blob":"7785c6dc9c5716e55b125275fb4aa5ece568e0ec","suite_tree":"9f28d4f3efa0332bfea189e7ce28620b96424712","platform":"linux","node":"v22.22.0","reference":"RobotRegistryFoundation/rcan-ts@ff8c73dface3814300eeb560ba4a30ac76003165 (src/encoding.ts canonicalJson by type stripping)","adapter":".regenerate/suite/adapters/sdk-ts","flags":"--reference --na envelopeHash,recordHash,validateEnvelope,verifyChain,auditAuthority,replay,cli,if-regen","suite":{"passed":125,"total":134,"advisory":"0/0","skipped":0,"na":318,"failing":[{"case":"cj-sort-digits","reqs":["REQ-CJ-001"],"class":"c:D-003"},{"case":"cj-overflow","reqs":["REQ-CJ-004"],"class":"c:D-005"},{"case":"cj-overflow-neg-nested","reqs":["REQ-CJ-004"],"class":"c:D-005"},{"case":"cj-overflow-key-order","reqs":["REQ-CJ-004"],"class":"c:D-005"},{"case":"cj-lone-high","reqs":["REQ-CJ-005"],"class":"c:D-006"},{"case":"cj-lone-low","reqs":["REQ-CJ-005"],"class":"c:D-006"},{"case":"cj-reversed-pair","reqs":["REQ-CJ-005"],"class":"c:D-006"},{"case":"cj-lone-in-key","reqs":["REQ-CJ-005"],"class":"c:D-006"},{"case":"cj-lone-nested","reqs":["REQ-CJ-005"],"class":"c:D-006"}]},"notes":"Comparison subject, canonical cases only. Fails cj-sort-digits (index-like names come out first), plus the reference's non-finite and lone-surrogate behavior."}
{"run":"r01","kind":"blind","date":"2026-10-07T22:32:35Z","outcome":"finished","spec_tag":"spec-v1.0.0","spec_blob":"964bb66d837bb15047a067a0b349c32cf0cd4613","decisions_blob":"7785c6dc9c5716e55b125275fb4aa5ece568e0ec","prompt_blob":"4004685c4f5d0da1078ec37dd0212c7efcddec7e","suite_tree":"9f28d4f3efa0332bfea189e7ce28620b96424712","model":"sonnet","model_id":"claude-sonnet-5-5","lang":"ts","sandbox_id":"rzahqy","isolation":"nested -p via launch-blind.sh@03386585e13f60cd85f74c1e88256a737483c9c6","audit":{"violations":0,"init_ok":true,"denied_calls":2,"recognized_reference":false},"turns":25,"duration_min":4.1,"cost_usd":0.8040262,"own_tests":{"passed":11,"failed":0},"suite":{"passed":452,"total":452,"advisory":"0/0","skipped":0,"na":0,"failing":[]},"loc":314,"deps":[],"choices":{"total":17,"pin":0,"clarify":3,"open":5,"wrong":0,"quirk":0,"already_pinned":9},"silent_divergences":{"total":0,"clarify":0,"wrong":0,"suite_bug":0},"clean":false,"branch":"regen/r01","transcript_sha256":"e863b6267037ad2d7cf5c750dd444deae5844cd536e79c3c8e88ac49b360cabe","notes":"452/452. Not clean: C-2, C-3, C-5 clarify. C-10 exposed a suite bug (inherited member names treated as known)."}
{"run":"r00.1","kind":"reference","date":"2026-10-07T22:39:09Z","outcome":"finished","spec_tag":"spec-v1.0.1","spec_blob":"a8536785502388d5c8eb0c648bdb6183cf89a131","decisions_blob":"683f9bf1bf620e42886dbd80b7c206a82ccb8c2a","suite_tree":"a7a9214c3212451ba96b5d233663dd4ccbfdda9c","platform":"linux","node":"v22.22.0","reference":"RobotRegistryFoundation/rcan-spec@16fc1a4a829426d43b200db4d8e65537810f2e6b (scripts/assurance/evidence-chain.ts by type stripping; schemas/envelope.json with ajv 8.20.0)","adapter":".regenerate/suite/adapters/reference","flags":"--reference","suite":{"passed":387,"total":436,"advisory":"0/0","skipped":0,"na":31,"failing":[{"case":"shape-seq-negative","reqs":["REQ-CH-001"],"class":"c:D-009"},{"case":"shape-seq-fraction","reqs":["REQ-CH-001"],"class":"c:D-009"},{"case":"shape-seq-string","reqs":["REQ-CH-001"],"class":"c:D-009"},{"case":"shape-seq-bool","reqs":["REQ-CH-001"],"class":"c:D-009"},{"case":"shape-seq-missing","reqs":["REQ-CH-001"],"class":"c:D-009"},{"case":"shape-prev-missing","reqs":["REQ-CH-001"],"class":"c:D-009"},{"case":"shape-hash-number","reqs":["REQ-CH-001"],"class":"c:D-009"},{"case":"shape-record-not-object","reqs":["REQ-CH-001"],"class":"c:D-009"},{"case":"shape-audit-seq-missing","reqs":["REQ-CH-001"],"class":"c:D-009"},{"case":"shape-replay-record-array","reqs":["REQ-CH-001"],"class":"c:D-009"},{"case":"cj-overflow","reqs":["REQ-CJ-004"],"class":"c:D-005"},{"case":"cj-overflow-neg-nested","reqs":["REQ-CJ-004"],"class":"c:D-005"},{"case":"cj-overflow-key-order","reqs":["REQ-CJ-004"],"class":"c:D-005"},{"case":"cj-lone-high","reqs":["REQ-CJ-005"],"class":"c:D-006"},{"case":"cj-lone-low","reqs":["REQ-CJ-005"],"class":"c:D-006"},{"case":"cj-reversed-pair","reqs":["REQ-CJ-005"],"class":"c:D-006"},{"case":"cj-lone-in-key","reqs":["REQ-CJ-005"],"class":"c:D-006"},{"case":"cj-lone-nested","reqs":["REQ-CJ-005"],"class":"c:D-006"},{"case":"ha-envelope-overflow","reqs":["REQ-HA-002","REQ-CJ-004"],"class":"c:D-005"},{"case":"ha-record-lone","reqs":["REQ-HA-003","REQ-CJ-005"],"class":"c:D-006"},{"case":"ch-record-overflow","reqs":["REQ-CH-002","REQ-CJ-004"],"class":"c:D-005"},{"case":"aa-no-authority-number","reqs":["REQ-AA-002"],"class":"c:D-011"},{"case":"aa-principal-true","reqs":["REQ-AA-002"],"class":"c:D-011"},{"case":"rp-speed-string-unchecked-bound","reqs":["REQ-RP-001"],"class":"b:D-014"},{"case":"rp-bound-not-number","reqs":["REQ-RP-002"],"class":"c:D-017"},{"case":"rp-keep-out-skips-non-polygon","reqs":["REQ-RP-002"],"class":"c:D-017"},{"case":"rp-keep-out-bad-element","reqs":["REQ-RP-002"],"class":"c:D-017"},{"case":"rp-keep-in-bad-element","reqs":["REQ-RP-002"],"class":"c:D-017"},{"case":"rp-keep-in-not-polygon","reqs":["REQ-RP-002"],"class":"c:D-017"},{"case":"rp-target-not-point","reqs":["REQ-RP-001"],"class":"c:D-017"},{"case":"rp-allow-nonfinite-error","reqs":["REQ-RP-001","REQ-IF-007"],"class":"b:D-012"},{"case":"rp-allow-not-object-lazy","reqs":["REQ-RP-001","REQ-IF-007"],"class":"b:D-012"},{"case":"rp-stop-ignores-bounds","reqs":["REQ-RP-001"],"class":"b:D-014"},{"case":"rp-applied-not-object","reqs":["REQ-RP-001"],"class":"b:D-012"},{"case":"rp-allow-modified","reqs":["REQ-RP-001"],"class":"b:D-012"},{"case":"rp-allow-cmd-missing","reqs":["REQ-RP-001"],"class":"b:D-012"},{"case":"rp-allow-extra-applied","reqs":["REQ-RP-001","REQ-RP-004"],"class":"b:D-012"},{"case":"rp-allow-bool-vs-number","reqs":["REQ-RP-001","REQ-RP-004"],"class":"b:D-012"},{"case":"rp-unchecked-wrong-type","reqs":["REQ-RP-004"],"class":"b:D-014"},{"case":"rp-unchecked-utf16-order","reqs":["REQ-RP-004"],"class":"b:D-014"},{"case":"rp-unchecked-inherited-names","reqs":["REQ-RP-004"],"class":"b:D-014"},{"case":"rp-missing-reason","reqs":["REQ-RP-001"],"class":"b:D-012"},{"case":"rp-unknown-decision","reqs":["REQ-RP-001"],"class":"b:D-012"},{"case":"rp-unchecked-fields","reqs":["REQ-RP-004"],"class":"b:D-014"},{"case":"rp-unchecked-not-from-reject-or-nonobject","reqs":["REQ-RP-004"],"class":"b:D-012"},{"case":"rp-order-in-record","reqs":["REQ-RP-001"],"class":"b:D-012"},{"case":"rp-order-allow-full","reqs":["REQ-RP-001"],"class":"b:D-012"},{"case":"rp-envelope-overflow","reqs":["REQ-RP-001","REQ-CJ-004"],"class":"c:D-005"},{"case":"rp-records-many","reqs":["REQ-RP-001","REQ-RP-004"],"class":"b:D-012"}]},"notes":"Same explanations as r00; the 5 new failures are new cases from r01 (D-012 2, D-014 1, D-017 2). All 49 explained: b:D-012 13, b:D-014 6, c:D-005 6, c:D-006 6, c:D-009 10, c:D-011 2, c:D-017 6."}
{"run":"r01.rescore@spec-v1.0.1","kind":"rescore","of":"r01","date":"2026-10-07T22:39:09Z","spec_tag":"spec-v1.0.1","suite_tree":"a7a9214c3212451ba96b5d233663dd4ccbfdda9c","suite":{"passed":467,"total":467,"advisory":"0/0","skipped":0,"na":0,"failing":[]},"notes":"Informational; Linux."}
{"run":"r02","kind":"blind","date":"2026-10-07T22:44:10Z","outcome":"orphaned","spec_tag":"spec-v1.0.1","spec_blob":"a8536785502388d5c8eb0c648bdb6183cf89a131","decisions_blob":"683f9bf1bf620e42886dbd80b7c206a82ccb8c2a","prompt_blob":"4004685c4f5d0da1078ec37dd0212c7efcddec7e","suite_tree":"a7a9214c3212451ba96b5d233663dd4ccbfdda9c","model":"sonnet","model_id":"claude-sonnet-5-5","lang":"ts","sandbox_id":"kdltny","isolation":"nested -p via launch-blind.sh@03386585e13f60cd85f74c1e88256a737483c9c6 (orchestrator environment inherited)","audit":{"violations":0,"init_ok":true,"denied_calls":2,"recognized_reference":false},"turns":null,"duration_min":4.6,"cost_usd":null,"own_tests":{"passed":15,"failed":0},"suite":{"passed":466,"total":467,"advisory":"0/0","skipped":0,"na":0,"failing":[{"case":"bu-deps","reqs":["REQ-BU-002"],"class":"suite_bug"}]},"loc":286,"deps":[],"choices":{"total":16,"pin":0,"clarify":1,"open":10,"wrong":0,"quirk":0,"already_pinned":5},"silent_divergences":{"total":1,"clarify":0,"wrong":0,"suite_bug":1},"clean":false,"branch":"regen/r02","transcript_sha256":"530976b7d9a56d86d8229093afcd63b10f890c6e710b5b4f53274eab1ce1f88d","notes":"Orphaned: the container restarted during the builder's final test run; no result line (46 assistant messages; turns and cost unknown). Duration from launch to last transcript write. bu-deps failure is a suite bug (regex in the builder's own test read as an import). C-10 clarify."}
{"run":"r00.2","kind":"reference","date":"2026-10-07T22:50:42Z","outcome":"finished","spec_tag":"spec-v1.0.2","spec_blob":"5084106c56dac5249de8e1dfe4021d027994e597","decisions_blob":"99e6abad458195ee6b023151225690290a088435","suite_tree":"c8404f16101c2a9d7daaa4a663aa5d00600e2b45","platform":"linux","node":"v22.22.0","reference":"RobotRegistryFoundation/rcan-spec@16fc1a4a829426d43b200db4d8e65537810f2e6b (scripts/assurance/evidence-chain.ts by type stripping; schemas/envelope.json with ajv 8.20.0)","adapter":".regenerate/suite/adapters/reference","flags":"--reference","suite":{"passed":387,"total":437,"advisory":"0/0","skipped":0,"na":31,"failing":[{"case":"shape-seq-negative","reqs":["REQ-CH-001"],"class":"c:D-009"},{"case":"shape-seq-fraction","reqs":["REQ-CH-001"],"class":"c:D-009"},{"case":"shape-seq-string","reqs":["REQ-CH-001"],"class":"c:D-009"},{"case":"shape-seq-bool","reqs":["REQ-CH-001"],"class":"c:D-009"},{"case":"shape-seq-infinite","reqs":["REQ-CH-001","REQ-IF-006"],"class":"c:D-009"},{"case":"shape-seq-missing","reqs":["REQ-CH-001"],"class":"c:D-009"},{"case":"shape-prev-missing","reqs":["REQ-CH-001"],"class":"c:D-009"},{"case":"shape-hash-number","reqs":["REQ-CH-001"],"class":"c:D-009"},{"case":"shape-record-not-object","reqs":["REQ-CH-001"],"class":"c:D-009"},{"case":"shape-audit-seq-missing","reqs":["REQ-CH-001"],"class":"c:D-009"},{"case":"shape-replay-record-array","reqs":["REQ-CH-001"],"class":"c:D-009"},{"case":"cj-overflow","reqs":["REQ-CJ-004"],"class":"c:D-005"},{"case":"cj-overflow-neg-nested","reqs":["REQ-CJ-004"],"class":"c:D-005"},{"case":"cj-overflow-key-order","reqs":["REQ-CJ-004"],"class":"c:D-005"},{"case":"cj-lone-high","reqs":["REQ-CJ-005"],"class":"c:D-006"},{"case":"cj-lone-low","reqs":["REQ-CJ-005"],"class":"c:D-006"},{"case":"cj-reversed-pair","reqs":["REQ-CJ-005"],"class":"c:D-006"},{"case":"cj-lone-in-key","reqs":["REQ-CJ-005"],"class":"c:D-006"},{"case":"cj-lone-nested","reqs":["REQ-CJ-005"],"class":"c:D-006"},{"case":"ha-envelope-overflow","reqs":["REQ-HA-002","REQ-CJ-004"],"class":"c:D-005"},{"case":"ha-record-lone","reqs":["REQ-HA-003","REQ-CJ-005"],"class":"c:D-006"},{"case":"ch-record-overflow","reqs":["REQ-CH-002","REQ-CJ-004"],"class":"c:D-005"},{"case":"aa-no-authority-number","reqs":["REQ-AA-002"],"class":"c:D-011"},{"case":"aa-principal-true","reqs":["REQ-AA-002"],"class":"c:D-011"},{"case":"rp-speed-string-unchecked-bound","reqs":["REQ-RP-001"],"class":"b:D-014"},{"case":"rp-bound-not-number","reqs":["REQ-RP-002"],"class":"c:D-017"},{"case":"rp-keep-out-skips-non-polygon","reqs":["REQ-RP-002"],"class":"c:D-017"},{"case":"rp-keep-out-bad-element","reqs":["REQ-RP-002"],"class":"c:D-017"},{"case":"rp-keep-in-bad-element","reqs":["REQ-RP-002"],"class":"c:D-017"},{"case":"rp-keep-in-not-polygon","reqs":["REQ-RP-002"],"class":"c:D-017"},{"case":"rp-target-not-point","reqs":["REQ-RP-001"],"class":"c:D-017"},{"case":"rp-allow-nonfinite-error","reqs":["REQ-RP-001","REQ-IF-007"],"class":"b:D-012"},{"case":"rp-allow-not-object-lazy","reqs":["REQ-RP-001","REQ-IF-007"],"class":"b:D-012"},{"case":"rp-stop-ignores-bounds","reqs":["REQ-RP-001"],"class":"b:D-014"},{"case":"rp-applied-not-object","reqs":["REQ-RP-001"],"class":"b:D-012"},{"case":"rp-allow-modified","reqs":["REQ-RP-001"],"class":"b:D-012"},{"case":"rp-allow-cmd-missing","reqs":["REQ-RP-001"],"class":"b:D-012"},{"case":"rp-allow-extra-applied","reqs":["REQ-RP-001","REQ-RP-004"],"class":"b:D-012"},{"case":"rp-allow-bool-vs-number","reqs":["REQ-RP-001","REQ-RP-004"],"class":"b:D-012"},{"case":"rp-unchecked-wrong-type","reqs":["REQ-RP-004"],"class":"b:D-014"},{"case":"rp-unchecked-utf16-order","reqs":["REQ-RP-004"],"class":"b:D-014"},{"case":"rp-unchecked-inherited-names","reqs":["REQ-RP-004"],"class":"b:D-014"},{"case":"rp-missing-reason","reqs":["REQ-RP-001"],"class":"b:D-012"},{"case":"rp-unknown-decision","reqs":["REQ-RP-001"],"class":"b:D-012"},{"case":"rp-unchecked-fields","reqs":["REQ-RP-004"],"class":"b:D-014"},{"case":"rp-unchecked-not-from-reject-or-nonobject","reqs":["REQ-RP-004"],"class":"b:D-012"},{"case":"rp-order-in-record","reqs":["REQ-RP-001"],"class":"b:D-012"},{"case":"rp-order-allow-full","reqs":["REQ-RP-001"],"class":"b:D-012"},{"case":"rp-envelope-overflow","reqs":["REQ-RP-001","REQ-CJ-004"],"class":"c:D-005"},{"case":"rp-records-many","reqs":["REQ-RP-001","REQ-RP-004"],"class":"b:D-012"}]},"notes":"Same explanations; the one new failure is the new case shape-seq-infinite (c:D-009). All 50 explained: b:D-012 13, b:D-014 6, c:D-005 6, c:D-006 6, c:D-009 11, c:D-011 2, c:D-017 6."}
{"run":"r03","kind":"blind","date":"2026-10-07T22:54:19Z","outcome":"finished","spec_tag":"spec-v1.0.2","spec_blob":"5084106c56dac5249de8e1dfe4021d027994e597","decisions_blob":"99e6abad458195ee6b023151225690290a088435","prompt_blob":"4004685c4f5d0da1078ec37dd0212c7efcddec7e","suite_tree":"c8404f16101c2a9d7daaa4a663aa5d00600e2b45","model":"sonnet","model_id":"claude-sonnet-5-5","lang":"ts","sandbox_id":"nsbplq","isolation":"nested -p via launch-blind.sh@f94f845d4f1efe11b0d10539b2a98f561847942e (allow-listed environment)","audit":{"violations":0,"init_ok":true,"denied_calls":1,"recognized_reference":false},"turns":25,"duration_min":3.1,"cost_usd":0.6792364,"own_tests":{"passed":9,"failed":0},"suite":{"passed":468,"total":468,"advisory":"0/0","skipped":0,"na":0,"failing":[]},"loc":313,"deps":[],"choices":{"total":20,"pin":0,"clarify":0,"open":10,"wrong":0,"quirk":0,"already_pinned":10},"silent_divergences":{"total":0,"clarify":0,"wrong":0,"suite_bug":0},"clean":true,"branch":"regen/r03","transcript_sha256":"def11e3d9fe1b66df911b323565feb8ee5b6f09b0d3a90f827d1aeec57fc4626","notes":"First clean run. C-12 (driver answers only at end of input) becomes OPEN-IF-005 on main after r04."}
{"run":"r04","kind":"blind","date":"2026-10-07T23:00:04Z","outcome":"finished","spec_tag":"spec-v1.0.2","spec_blob":"5084106c56dac5249de8e1dfe4021d027994e597","decisions_blob":"99e6abad458195ee6b023151225690290a088435","prompt_blob":"821ad09ca16664dc274c25a099a1e904ee3477c1","suite_tree":"c8404f16101c2a9d7daaa4a663aa5d00600e2b45","model":"sonnet","model_id":"claude-sonnet-5-5","lang":"py","sandbox_id":"qugdzr","isolation":"nested -p via launch-blind.sh@f94f845d4f1efe11b0d10539b2a98f561847942e (allow-listed environment)","audit":{"violations":0,"init_ok":true,"denied_calls":1,"recognized_reference":false},"turns":17,"duration_min":3.3,"cost_usd":0.6323598,"own_tests":{"passed":28,"failed":0},"suite":{"passed":468,"total":468,"advisory":"0/0","skipped":0,"na":0,"failing":[]},"loc":455,"deps":[],"choices":{"total":16,"pin":0,"clarify":0,"open":9,"wrong":0,"quirk":0,"already_pinned":7},"silent_divergences":{"total":0,"clarify":0,"wrong":0,"suite_bug":0},"clean":true,"branch":"regen/r04","transcript_sha256":"2311e8af55ed5183aa9d4f4cf8ec05556a89847903cb373112afa1b0f7e129dc","notes":"Second language clean on the same tag as r03. C-5 becomes OPEN-CH-002 on main; C-7 wording improved on main."}
{"run":"r03","kind":"promotion","lang":"ts","spec_tag":"spec-v1.0.2","impl_tree":"6245c794375f435885ea889b83448990ad16bdca","date":"2026-10-07T23:02:41Z"}
{"run":"r04","kind":"promotion","lang":"py","spec_tag":"spec-v1.0.2","impl_tree":"5fda7d8ffadf1c2e1212d831fc961d6cfabf1122","date":"2026-10-07T23:02:41Z"}
{"run":"r00.3","kind":"reference","date":"2026-10-07T23:04:06Z","outcome":"finished","spec_tag":"spec-v1.0.3","spec_blob":"f66ec4adfb988ebe8fb33cb47af7ef73683d81de","decisions_blob":"4fd6ab236fbb294abf299e45ee19bf7906d7954e","suite_tree":"76cbd35928d0c576a259832b12a7520055b33d71","platform":"linux","node":"v22.22.0","reference":"RobotRegistryFoundation/rcan-spec@16fc1a4a829426d43b200db4d8e65537810f2e6b (scripts/assurance/evidence-chain.ts by type stripping; schemas/envelope.json with ajv 8.20.0)","adapter":".regenerate/suite/adapters/reference","flags":"--reference","suite":{"passed":388,"total":438,"advisory":"0/0","skipped":0,"na":31,"failing":[{"case":"shape-seq-negative","reqs":["REQ-CH-001"],"class":"c:D-009"},{"case":"shape-seq-fraction","reqs":["REQ-CH-001"],"class":"c:D-009"},{"case":"shape-seq-string","reqs":["REQ-CH-001"],"class":"c:D-009"},{"case":"shape-seq-bool","reqs":["REQ-CH-001"],"class":"c:D-009"},{"case":"shape-seq-infinite","reqs":["REQ-CH-001","REQ-IF-006"],"class":"c:D-009"},{"case":"shape-seq-missing","reqs":["REQ-CH-001"],"class":"c:D-009"},{"case":"shape-prev-missing","reqs":["REQ-CH-001"],"class":"c:D-009"},{"case":"shape-hash-number","reqs":["REQ-CH-001"],"class":"c:D-009"},{"case":"shape-record-not-object","reqs":["REQ-CH-001"],"class":"c:D-009"},{"case":"shape-audit-seq-missing","reqs":["REQ-CH-001"],"class":"c:D-009"},{"case":"shape-replay-record-array","reqs":["REQ-CH-001"],"class":"c:D-009"},{"case":"cj-overflow","reqs":["REQ-CJ-004"],"class":"c:D-005"},{"case":"cj-overflow-neg-nested","reqs":["REQ-CJ-004"],"class":"c:D-005"},{"case":"cj-overflow-key-order","reqs":["REQ-CJ-004"],"class":"c:D-005"},{"case":"cj-lone-high","reqs":["REQ-CJ-005"],"class":"c:D-006"},{"case":"cj-lone-low","reqs":["REQ-CJ-005"],"class":"c:D-006"},{"case":"cj-reversed-pair","reqs":["REQ-CJ-005"],"class":"c:D-006"},{"case":"cj-lone-in-key","reqs":["REQ-CJ-005"],"class":"c:D-006"},{"case":"cj-lone-nested","reqs":["REQ-CJ-005"],"class":"c:D-006"},{"case":"ha-envelope-overflow","reqs":["REQ-HA-002","REQ-CJ-004"],"class":"c:D-005"},{"case":"ha-record-lone","reqs":["REQ-HA-003","REQ-CJ-005"],"class":"c:D-006"},{"case":"ch-record-overflow","reqs":["REQ-CH-002","REQ-CJ-004"],"class":"c:D-005"},{"case":"aa-no-authority-number","reqs":["REQ-AA-002"],"class":"c:D-011"},{"case":"aa-principal-true","reqs":["REQ-AA-002"],"class":"c:D-011"},{"case":"rp-speed-string-unchecked-bound","reqs":["REQ-RP-001"],"class":"b:D-014"},{"case":"rp-bound-not-number","reqs":["REQ-RP-002"],"class":"c:D-017"},{"case":"rp-keep-out-skips-non-polygon","reqs":["REQ-RP-002"],"class":"c:D-017"},{"case":"rp-keep-out-bad-element","reqs":["REQ-RP-002"],"class":"c:D-017"},{"case":"rp-keep-in-bad-element","reqs":["REQ-RP-002"],"class":"c:D-017"},{"case":"rp-keep-in-not-polygon","reqs":["REQ-RP-002"],"class":"c:D-017"},{"case":"rp-target-not-point","reqs":["REQ-RP-001"],"class":"c:D-017"},{"case":"rp-allow-nonfinite-error","reqs":["REQ-RP-001","REQ-IF-007"],"class":"b:D-012"},{"case":"rp-allow-not-object-lazy","reqs":["REQ-RP-001","REQ-IF-007"],"class":"b:D-012"},{"case":"rp-stop-ignores-bounds","reqs":["REQ-RP-001"],"class":"b:D-014"},{"case":"rp-applied-not-object","reqs":["REQ-RP-001"],"class":"b:D-012"},{"case":"rp-allow-modified","reqs":["REQ-RP-001"],"class":"b:D-012"},{"case":"rp-allow-cmd-missing","reqs":["REQ-RP-001"],"class":"b:D-012"},{"case":"rp-allow-extra-applied","reqs":["REQ-RP-001","REQ-RP-004"],"class":"b:D-012"},{"case":"rp-allow-bool-vs-number","reqs":["REQ-RP-001","REQ-RP-004"],"class":"b:D-012"},{"case":"rp-unchecked-wrong-type","reqs":["REQ-RP-004"],"class":"b:D-014"},{"case":"rp-unchecked-utf16-order","reqs":["REQ-RP-004"],"class":"b:D-014"},{"case":"rp-unchecked-inherited-names","reqs":["REQ-RP-004"],"class":"b:D-014"},{"case":"rp-missing-reason","reqs":["REQ-RP-001"],"class":"b:D-012"},{"case":"rp-unknown-decision","reqs":["REQ-RP-001"],"class":"b:D-012"},{"case":"rp-unchecked-fields","reqs":["REQ-RP-004"],"class":"b:D-014"},{"case":"rp-unchecked-not-from-reject-or-nonobject","reqs":["REQ-RP-004"],"class":"b:D-012"},{"case":"rp-order-in-record","reqs":["REQ-RP-001"],"class":"b:D-012"},{"case":"rp-order-allow-full","reqs":["REQ-RP-001"],"class":"b:D-012"},{"case":"rp-envelope-overflow","reqs":["REQ-RP-001","REQ-CJ-004"],"class":"c:D-005"},{"case":"rp-records-many","reqs":["REQ-RP-001","REQ-RP-004"],"class":"b:D-012"}]},"notes":"Same 50 explained failures as r00.2; the new case passes (answered by the adapter)."}
{"run":"r03.rescore@spec-v1.0.3","kind":"rescore","of":"r03","date":"2026-10-07T23:04:06Z","spec_tag":"spec-v1.0.3","suite_tree":"76cbd35928d0c576a259832b12a7520055b33d71","suite":{"passed":469,"total":469,"advisory":"0/0","skipped":0,"na":0,"failing":[]},"notes":"Informational; the released impl/ts (built at spec-v1.0.2) also passes the 1.0.3 suite. Linux."}
{"run":"r04.rescore@spec-v1.0.3","kind":"rescore","of":"r04","date":"2026-10-07T23:04:06Z","spec_tag":"spec-v1.0.3","suite_tree":"76cbd35928d0c576a259832b12a7520055b33d71","suite":{"passed":469,"total":469,"advisory":"0/0","skipped":0,"na":0,"failing":[]},"notes":"Informational; the released impl/py (built at spec-v1.0.2) also passes the 1.0.3 suite. Linux."}
{"run":"upstream.1","kind":"upstream","date":"2026-10-08T06:07:41Z","outcome":"finished","spec_tag":"spec-v1.0.3","spec_blob":"f66ec4adfb988ebe8fb33cb47af7ef73683d81de","decisions_blob":"4fd6ab236fbb294abf299e45ee19bf7906d7954e","suite_tree":"76cbd35928d0c576a259832b12a7520055b33d71","platform":"linux","node":"v22.22.0","target":"RobotRegistryFoundation/rcan-spec@0f425ecd51f487d0107e251561e80eff3816c949 merged with @448552dbe5d025c3bc7ef176b49ae397ab4707c5 (scripts/assurance/evidence-chain.ts by type stripping; schemas/envelope.json with ajv 8.20.0)","prs":["https://github.com/RobotRegistryFoundation/rcan-spec/pull/224","https://github.com/RobotRegistryFoundation/rcan-spec/pull/225"],"issue":"https://github.com/RobotRegistryFoundation/rcan-spec/issues/223","adapter":"copy of .regenerate/suite/adapters/reference with a validation-only error translation, not committed (driver.mjs sha256 b5a799437915497d629199a4d94a0b4362ab701510471f9328283ab0e0008da2)","flags":"--reference","suite":{"passed":438,"total":438,"advisory":"0/0","skipped":0,"na":31,"failing":[]},"notes":"The reference verifier with the fixes proposed upstream in rcan-spec#224 and #225 (both open, #224 a draft, when run), merged locally. The adapter copy maps the verifier's new explicit errors to the suite's codes: CanonicalJsonError by its code, and the TypeError for malformed records to bad_request. Compare r00.3 (388/438); the verifier is unchanged on rcan-spec master since the r00 commit."}
{"run":"upstream.1-ts","kind":"upstream","date":"2026-10-08T06:07:42Z","outcome":"finished","spec_tag":"spec-v1.0.3","spec_blob":"f66ec4adfb988ebe8fb33cb47af7ef73683d81de","decisions_blob":"4fd6ab236fbb294abf299e45ee19bf7906d7954e","suite_tree":"76cbd35928d0c576a259832b12a7520055b33d71","platform":"linux","node":"v22.22.0","target":"RobotRegistryFoundation/rcan-ts@f573706d24614411f691417d02415cfae2edefa2 merged with @b563fb551587d6a6379a660cb961506bca6b8bd7 (built with tsup, dist/index.mjs; schemas/envelope.json from rcan-spec with ajv 8.20.0)","prs":["https://github.com/RobotRegistryFoundation/rcan-ts/pull/55","https://github.com/RobotRegistryFoundation/rcan-ts/pull/56"],"issue":"https://github.com/RobotRegistryFoundation/rcan-spec/issues/223","adapter":"copy of .regenerate/suite/adapters/reference that awaits the SDK's async verifyChain and replayAgainstEnvelope, with a validation-only error translation, not committed (driver.mjs sha256 4a76ce70cbb5185ff341cd3eafb1801178532fdaa31ad0728bf60d8da7b53a1c)","flags":"--reference --na cli","suite":{"passed":431,"total":431,"advisory":"0/0","skipped":0,"na":38,"failing":[]},"notes":"rcan-ts's canonicalJson and its port of the verifier with the fixes proposed upstream in rcan-ts#55 and #56 (both open when run), merged locally. The adapter copy maps CanonicalJsonError and RCANEncodingError by their code, and the TypeError for malformed records to bad_request. The SDK has no verifier command line, so the CLI cases are n/a. rcan-ts master (ff8c73d) through the same adapter copy: 380/431."}
{"run":"upstream.1-port","kind":"upstream","date":"2026-10-08T06:07:43Z","outcome":"finished","spec_tag":"spec-v1.0.3","spec_blob":"f66ec4adfb988ebe8fb33cb47af7ef73683d81de","decisions_blob":"4fd6ab236fbb294abf299e45ee19bf7906d7954e","suite_tree":"76cbd35928d0c576a259832b12a7520055b33d71","platform":"linux","node":"v22.22.0","target":"RobotRegistryFoundation/rcan-py@b718bf3fce17da2b1189f481439709f1eb3b2944 merged with @638ca3b49ad0d3c3b2942fd6fe0248d276d18c22 (rcan/assurance.py and rcan/encoding.py; Python 3.13.16)","prs":["https://github.com/RobotRegistryFoundation/rcan-py/pull/66","https://github.com/RobotRegistryFoundation/rcan-py/pull/67"],"issue":"https://github.com/RobotRegistryFoundation/rcan-spec/issues/223","adapter":"copy of .regenerate/suite/adapters/port-py with a validation-only error translation, not committed (driver.py sha256 07fb2dad453dc21cc80e31e06397262ef98e048bdf858d5ece92e47088b1876e)","flags":"--reference --na validateEnvelope,cli,if-regen","suite":{"passed":277,"total":277,"advisory":"0/0","skipped":0,"na":192,"failing":[]},"notes":"rcan-py's Python port of the verifier and its canonical_json with the fixes proposed upstream in rcan-py#66 and #67 (both open, #66 a draft, when run), merged locally. The adapter copy maps RCANEncodingError by its code and the TypeError for malformed records to bad_request. rcan-py main (0184314) through the committed adapter: 215/277."}