Repository navigation
data(t27b): bless the honest passes of master run 099ac2224 (14 up, 8 new) - #6667
Merged
Merged
Conversation
…ew) (Closes #6666) Tool-written data only. From lab run 099ac22 (finished 2026-10-06T01:49:39Z): 14 specs/tools/trinity/tri/* entries pass_vacuous -> pass, 8 new pass entries. Each has t27b pass with >= 1 runtime assert, reference pass, and per-test verdicts equal to the reference's. Not blessed: 4 pass -> timeout (#6664, interpreter fuel under qemu), specs/ci/affected.t27 mismatch (#6663, fix #6665), specs/compiler/zig_scoped_type.t27 (blocked). Counts: pass 439 -> 461, pass_vacuous 275 -> 261, not_pass 67 (cap unchanged). Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
Contributor
This was referenced Oct 6, 2026
Merged
Contributor
PR DashboardGenerated at: 2026-10-06 06:46:05 UTC
Summary
Seal Status
|
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
1 participant
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Closes #6666
Refs #6063
This PR contains tool-written data only:
docs/reports/t27b_expectations.json. It was not produced by a full--bless. A full bless would also write the four lab-load timeouts as regressions, and it refuses the affected.t27 mismatch. Instead,dump_ledger()fromscripts/tri_loop/t27b.pyre-serialised the current ledger with only the entries listed below changed. The list is taken from the ratchet findings of the lab run of master 099ac22 (run, finished 2026-10-06T01:49:39Z). That run already includes #6598 (b732090).Blessed (22). Each one has t27b
passwith at least one runtime assert, referencepass, and per-test verdicts identical to the reference's:specs/tools/trinity/tri/{bench,bio,blindspots,conscious,constants,cosmos,dashboard,quantum,reputation,sacred-const,spiral,swarm,test,vsa}.t27. Each has one test that pins the module's declared constants (KIND, FAMILY, SCHEMA, ROUTED, ...), with 1 to 3 runtime asserts. These are weak tests, but they are real ones.specs/automation/poster-facts-overlay.t27(10 tests),specs/ci/delivery_metrics.t27(18),specs/ci/derived_data.t27(18),specs/port/scripts/tri-sync.t27(7),specs/port/trinity/fpga/openxc7-synth/blink_working.t27(10 + 4 invariants),specs/port/trios/crates/trios-mcp/src/main.t27(12),specs/queen/review_valve.t27(8),specs/tri/sort/insertion_sort.t27(2).Not blessed, on purpose:
specs/benchmarks/kernel_{fib,matmul,ternary}.t27andspecs/port/trinity/fpga/openxc7-synth/d_g22_test.t27. The cause is t27b lab: 4 ratchet UNEXPECTED FAILUREs are --check interpreter fuel under qemu, not regressions #6664: the--checkinterpreter spends its 50M fuel under qemu, so these runs take 105-115 s against a 60 s budget, while the JIT alone takes 1-30 s. That is not a regression, so the entries staypass.specs/ci/affected.t27: the mismatch is a spec bug, ci/affected.t27: closure() reads set bytes it never wrote after set_add overflows (the t27b lab mismatch) #6663, fixed in fix(ci): affected.t27 closure() stops reading set bytes it never wrote (Closes #6663) #6665. It goes into the bless after a lab run of master that includes the fix.specs/compiler/zig_scoped_type.t27: t27b blocked (type gf16::GF16), not a pass, and the cap is not raised.Counts: pass 439 -> 461, pass_vacuous 275 -> 261, not_pass 67 -> 67,
max_not_pass67 (unchanged). 0 entries move down and 0 are removed. Thesourceblock names run 099ac22, which is where every moved entry comes from.tri t27b ratchetagainst the same run, after this change: UNEXPECTED FAILURE 4 (#6664), UNEXPECTED PASS 0, UNLISTED 2 (the two specs above), STALE 0, OVER CAP 0, BAD REASON 0, MOVED 0. Before this change: UNEXPECTED FAILURE 4, UNEXPECTED PASS 14, UNLISTED 10.🤖 Generated with Claude Code