Skip to content

feat(igla-coder): record the pilot's measured t27 result (Closes #1041) - #4796

Merged
gHashTag merged 1 commit into
masterfrom
feat/igla-coder-pilot-measured
Sep 25, 2026
Merged

gHashTag merged 1 commit into
masterfrom
feat/igla-coder-pilot-measured

Conversation

@gHashTag

Copy link
Copy Markdown
Owner

Records the igla-coder-gpu pilot's measured result into specs/igla/coder/pipeline.t27 — the spec the WARS arena's IGLA CODER lane (lane 03) reads. This is the "one form": the corpus is .t27 specs, the pilot is their execution, and the WARS arena reads the result back.

Closes #1041

What landed

The IGLA coder pipeline had no measured checkpoint, so WARS lane 03 shows "no executable checkpoint verified." The pilot now provides one, judged by t27c (the exact compiler judge):

  • checkpoints: fp100m + t27 fine-tune, tern100m + t27 fine-tune (100m params, 2.5B pretrain tokens, 3-epoch .t27 fine-tune)
  • strict set (391 items, both constant mutants fail): fp 8/391, tern 5/391 solved within 10 tries
  • all 466 items: fp pass@10 5.8% (27), tern 5.4% (25); compile@1 12–14% is the wall
  • t27 val bits/byte: fp 0.4589, tern 0.4957
  • source: gHashTag/igla-coder-gpu research/T27_BENCH.md

Honesty limits (BINDING)

  • The checkpoint is not yet published with a verifiable SHA, so the live WARS lane stays unregistered until it is. Flipping the tab additionally needs the checkpoint published and an arena run registered.
  • A 100m model solves ~2% of held-out functions in ten tries.
  • This is a software result judged by t27c, not a hardware or deployed-network one.

🤖 Generated with Claude Code

…ine spec

Closes #1041

The igla-coder-gpu pilot produced trained 100m fp/tern checkpoints and a t27
benchmark judged by t27c. This records that measured result into
specs/igla/coder/pipeline.t27 (the spec the WARS arena's IGLA CODER lane reads),
moving the pipeline from "described" to "measured":

- strict 391: fp 8, tern 5 solved within 10 tries
- all 466: fp pass@10 5.8% (27), tern 5.4% (25); compile@1 12-14% is the wall
- source: gHashTag/igla-coder-gpu research/T27_BENCH.md

Honesty limit: the checkpoint is not yet published with a verifiable SHA, so the
live WARS lane stays unregistered until it is; a software result judged by t27c,
not hardware or a deployed network.
@github-actions

Copy link
Copy Markdown
Contributor

📓 NotebookLM Notebook linked to this PR

This notebook contains session context, decisions, and artifacts for this work.

@github-actions

Copy link
Copy Markdown
Contributor

PR Dashboard

Generated at: 2026-09-24 17:45:51 UTC

Summary

Status Count
Total Open PRs 35
PRs with Failing Checks 32
PRs with All Checks Green 3
READY 3
FAILING 32
PENDING 0
NO CHECKS YET 0

Seal Status

  • ⚠️ STALE -- sha256(compiler.rs)=403499176a5d != manifest seal=87e5cbd3ad94.
    The committed NMSE numbers were certified against an older compiler.rs.
    Run scripts/reseal-check.sh locally for the two-step reseal command (advisory; not a merge gate).

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

[IGLA-Coder] P8 Integration into t27 and publication

1 participant