Repository navigation
test(v5): audit immutable development manuscript evidence - #325
TheHalfMoon wants to merge 13 commits into
Conversation
Signed-off-by: Gocceri <azialshehri@gmail.com>
|
Important Draft PR not reviewedDraft PRs are not automatically reviewed by default.
To automatically review draft PRs, update your CodeRabbit configuration: reviews:
auto_review:
drafts: true
Thanks for using CodeRabbit! It's free for OSS, and your support helps us grow. If you like it, consider giving us a shout-out. Comment |
Signed-off-by: Gocceri <azialshehri@gmail.com>
Signed-off-by: Gocceri <azialshehri@gmail.com>
Exact-head source-integrity hardening and public deterministic CI — 2026-10-09Forward-only successor commits (normal push, no history rewrite):
Independent execution of deterministic checks on GitHub (not independent scientific/clinical review): GitHub Actions run #37980954005 completed Unmet review/governance: This is not an external Alibaba OCR model verdict or independent methodologist review. GitHub previously classified the branch's DCO-only commits as unsigned; cryptographic signing and separate merge gates remain unresolved. Holm non-target family enumeration, seed-aware variance qualification and 90% power adequacy remain pending. PR is deliberately DRAFT / UNMERGED. No clinical, confirmatory, independent-family, release or publication claim is created. |
Signed-off-by: Gocceri <azialshehri@gmail.com>
Signed-off-by: Gocceri <azialshehri@gmail.com>
V5 S1 original source-case → task pairing proven against full R1 and R2 — 2026-10-10Added a genuinely model-free, full source-replay audit in this draft PR #325 (latest exact pushed HEAD Rebuilt from the pinned original source, not inferred from existing outcome labels: public
Scientific limit: one-to-one synthetic case/task identity does not validate clinical correctness, real-patient representativeness, independence of stochastic training seeds, conservative across-seed variance, a final frozen Holm non-target family, 90% prospective power, or any confirmatory/replication result. Existing negative/near-chance developmental findings are unchanged. No GPU/model inference, paid API, PHI or confirmatory/reserve access used. All PRs remain DRAFT; latest commit reports DCO only, GitHub cryptographic verification unsigned; independent scientific/OCR and founder authorization gates remain separate. |
2026-10-10 — Stacked dependency drift: PR #324 crosswalk changed after this exact-head integrity auditStatus: REPRODUCED READ-ONLY SHA-256 CONSISTENCY FINDING / NO CODE MUTATION / NO MERGE. This draft PR #325 currently remains at exact head Read-only inspection and an independently self-tested UTF-8 SHA-256 implementation confirm:
Required before any eventual merge: forward-only, provenance-preserving reconciliation of the #325 verifier binding and source semantics with the exact revised #324 crosswalk; update targeted negative regressions and rerun source-bound audit, all 307 frozen-entry checks and exact-head CI on the resulting branch. Ensure no mutable/unsigned source is quietly treated as the old snapshot. Do not solve this by disabling provenance checks, accepting multiple arbitrary hashes, force-pushing, rebasing or modifying any frozen evidence. Respect the existing independent review and cryptographic-signature/DCO gates (especially the separately recorded unsigned/mismatched sign-off on #324 head). No Mac execution, new model inference, GPU, paid API, confirmatory/reserve case, new PR or scientific/clinical claim was involved in this finding. This is a future stacked-integration blocker, not evidence that #325's existing head or earlier exact-head CI was fraudulent. |
Synchronize the downstream read-only evidence gate with the exact source-bound upstream development-only manuscript crosswalk. Preserve all 307 frozen original scientific bindings and no-go authority. Signed-off-by: Abdulaziz M. Shehri <alshehriofficial@gmail.com>
2026-10-10 — Forward-only stacked evidence-binding reconciliation VERIFIED by exact-head CIThis supersedes the mechanical SHA mismatch blocker reported above, not the independent scientific/signature gates. A normal forward-only commit
Genuine exact-head GitHub Actions: run #38073338441, event source head Still NO-GO: GitHub reports new commit #325 remains OPEN / DRAFT / UNMERGED; |
Forward-integrate the source-bound parent evidence, reject missing or altered ICC bytes, verify all 72 descriptive cells and preserve negative estimates plus independent scientific no-go flags. The original 307 frozen files remain unchanged. Signed-off-by: Gocceri <azialshehri@gmail.com>
2026-10-10 — SOURCE-COMPLETE ICC gate and exact-head CI successNew exact DRAFT PR head: Verified defect and repair: the preceding crosswalk text referred to original calculator ICC development evidence that the downstream verifier did not require to exist. Now Real Mac checks at resulting source before commit: full pytest 1,389 passed + 264 subtests, dedicated ICC/provenance tests passed, original source evidence verification Genuine exact-head GitHub CI: run #38074111231, SHA Hard gates still OPEN: local ED25519 Git signature verified with |
Fail closed when the development ICC result cannot be reproduced from original pinned matrices. Keep immutable evidence, 307 frozen files, no scientific claim promotion, and draft merge restrictions. Signed-off-by: Gocceri <azialshehri@gmail.com>
Use the exact action revision already bound by the V5 calculator ICC workflow while retaining read-only checkout and source-bound offline verification. Signed-off-by: Gocceri <azialshehri@gmail.com>
2026-10-10 — Exact-head original-source ICC replay and immutable Actions revision (DRAFT ONLY)Live exact head: This advances the existing source integrity workflow
Actual Mac verification: the analyzer independently replayed all original development source-bound matrices, yielding exact committed SHA-256 Real GitHub-hosted exact-head qualification: workflow run 38074952765 COMPLETED SUCCESS at Gates unchanged: this is development-only integrity evidence; no statistically approved complete primary Holm family, no validated source/calculator/three-seed variance or 90% power at 4096 cases, no independent scientific/methodology approval, no genuine independent Alibaba OCR/Jev/Pstack/Graft/e2e review certificate and no publication/clinical authorization. The new commits are locally SSH-signed and DCO-signed off, but GitHub reports Read-only |
Reconcile 72 original paired-SD and calculator-ICC development cells into 24 complete three-seed reviewer groups, retain all 12 negative ICC values and explicit unreviewed Holm/crossed-variance/power authority. Include immutable source replay, 307-entry audit, fail-closed mutation tests, CI and review documentation. No model inference, confirmatory access or scientific approval. Signed-off-by: Gocceri <azialshehri@gmail.com>
2026-10-10 — source-bound 24-group/72-cell V5 independent-statistics reviewer packet (development only)Exact head: Added outputs (five changed/additive files):
Actual verification on authorized macOS: original 307 frozen entries, 9 pinned source blobs, R1/R2 two independent original archives audit PASS; deterministic packet --verify and the actual new CI bash step replayed successfully. 30 focused tests PASS; full repository 1,400 tests PASS + 264 subtests PASS; Python syntax/YAML/diff checks PASS. The original ICC analyzer remained separate and unchanged. Alibaba Open Code Review v1.12.13 local preview identified 3 relevant files and did not perform independent LLM/provider review; Jev 1.13.0 performed an auxiliary nonapproval check, likewise not peer review. Live exact-head GitHub Actions: both independent run #38080357632 (source-bound manuscript integrity plus packet replay) and run #38080357624 (original calculator ICC source replay) COMPLETED SUCCESS at Scientifically blocked, explicitly unchanged: caller cannot infer/declare primary non-target Holm family/size from these data; true crossed covariance among 64 selected calculators, source cases and 3 training seeds is unqualified; no 90%-power certificate at 4096 cases; no clinical, publication, confirmatory, reserve or independent review authority. Issue #326 remains OPEN. Latest Mac commit locally SSH signed+DCO but GitHub marks |
Cross-check all original ICC moments and paired source-case sample SDs algebraically, including the negative finite-sample ICC estimates. Add fail-closed corruption tests and documentation; preserve source-bound packet bytes, original 307 frozen sources and every unapproved statistical authority flag. Signed-off-by: Gocceri <azialshehri@gmail.com>
2026-10-10 — independent ANOVA identity checks added to the source-bound reviewer packet (DRAFT)Exact new head: New mechanically falsifiable review protections: each of 72 stored source-case sample SD cells is recomputed independently from original calculator ANOVA mean-square components, Actual Mac verification: 34 focused source packet/integrity/ICC tests passed, including new independent corruption fixtures. Full repository 1,404 tests + 264 subtests passed. Exact YAML CI replay step and byte-identical packet verification passed. Only authorized Mac was used, no model/GPU, external paid API, reserved/confirmatory data, source/branch rewrite, or changes to another worktree's dirty files. Exact-head GitHub CI success: source-bound audit #38081017970 SUCCESS and original ICC replay #38081017999 SUCCESS, both at Authority boundaries unchanged: this proves internal consistency/reproducibility of development evidence only, not a valid crossed source-case/calculator/training-seed covariance model, a reviewed complete primary Holm family or 90% confirmatory power at 4,096 prospective source cases. Real qualified independent science/code/provenance review and founder governance under #326 remain pending. The PR stays OPEN DRAFT, no merge. |
Bind seven original preregistered intervention candidates to eight frozen draft assurance axes for exhaustive independent nomination review, explicitly without creating a 56-test Holm family or false power authority. Include 307-source audit, deterministic evidence, fail-closed tests and exact-head CI replay. Signed-off-by: Gocceri <azialshehri@gmail.com>
2026-10-11 — add source-bound undecided non-target hypothesis nomination coverageExact draft head: Scope: enumerates all 7 named prospective draft intervention IDs from original Real verification on authorized macOS: 307 frozen scientific files hash-verified without modification, original source text bytes and nine source-bound artifacts pinned, 8 new source-grid tests PASS; 31 focused tests PASS, 1,412 full-repository tests + 264 subtests PASS. Exact workflow bash replay compares generated payload bytes. Hosted exact-head GitHub Actions #38165661342 and #38165661351 both COMPLETED SUCCESS. No new model/confirmatory/reserve source IDs, paid compute, changing clinical claims, merge to main or false review. Review decision still open: an independent qualified methodologist must explicitly disposition these possible pairs and specify any additional native-metric hypothesis cells, then prospectively approve full Holm membership, crossed 3-seed/calculator/source-case covariance/missingness, margins and meaningful 90% power. Locally valid Mac SSH signature remains GitHub |
Use same-directory synced temporary files and no-clobber hardlink publication in reviewer packet and candidate coverage generators; cover short writes, disk failures, fsync failures, destination collisions and symlink preservation with synthetic regressions. Preserve source hashes, 307 frozen originals and all unapproved Holm, power and confirmatory flags. Signed-off-by: Gocceri <azialshehri@gmail.com>
2026-10-11 — no-clobber complete publication of source-bound development reviewer artifactsExact new head: Repair: shared, model-free Actual authorized Mac evidence: 38 focused tests PASS, 1,419 full repo tests and 264 subtests PASS, both exact committed evidence artifacts replayed byte-for-byte (their SHA-256 Gates: all complete non-target family, multi-seed crossed nuisance and 90% statistical power fields remain null/false, pending qualified external review. Local ED25519 signature is valid but GitHub key registration remains incomplete; no GitHub account or signing key settings changed. PR stays DRAFT/OPEN. |
Objective: fail-closed manuscript development evidence identity gate
This stacked DRAFT PR adds a read-only, deterministic, model-free audit of the already completed V5 development evidence and the previous development/manuscript crosswalk. It targets draft PR #324 (exact parent
6d2f1dd2e96ac1e1dc62a2743d7c11e8c6bce2a5). Scientific/claim/original frozen files, the working manuscript, original research branch andmainremain unchanged under TheHalfMoon/commandMed.Exact source/evidence safeguards
repeatability95=0only as measured for the four predeclared primary and three secondary metrics over two full same-configuration runs; preserves near-chance baseline and no cross-seed/hardware/clinical inference.independent_peer_review=false,power_adequacy=NOT_QUALIFIED,confirmatory=false,clinical_validity=false,publication_authority=false.macOS exact-head qualification
git diff --check, execution of read-only audit against authentic files: PASS, including 307 hashes, 8 bound source files, original 2 ZIPs, 72 inventory cells.Hard boundaries
No new model runs, Kaggle reruns, private/PHI data, paid API, source/test sampling manipulation, new scientific hypothesis, calibration settings, domain-floor selection, confirmatory/reserve identity, cross-backbone replication, or publication. A passing model-free audit is not a substitute for independent scientific review. The exact primary non-target Holm family, seed-aware conservative variance methodology and 90% power gate are NOT FROZEN/QUALIFIED, and the claims remain unproven. Do not merge this or ancestor draft PRs without their genuine review, signature and founder gates.
Summary by cubic
Adds fail-closed, model-free audits of the V5 manuscript's locked development evidence, now run automatically on pull requests.
scripts/v5_manuscript_development_evidence_audit.pyverifies SHA-256 hashes of nine versioned evidence sources plus both original R1/R2 Kaggle ZIP archives, re-checks all 307 frozen entry files, and validates the 72-cell descriptive SD inventory, the 72-cell development-only calculator ICC inventory, and repeatability metrics.scripts/v5_s1_source_case_pairing_audit.pyreplays the frozen rule-oracle source generator against the pinned public RiskCalcs JSON to confirm each source case maps one-to-one to a task ID (8,192 cases, 16,384 rows, two ordered prompt variants each) across both full R1 and R2 matrices.scripts/v5_s1_statistical_review_packet.pyindependently reconstructs the 72 paired-SD and 72 calculator-ICC cells algebraically and bridges them into 24 three-seed reviewer groups, retaining all 12 negative ICC estimates without qualifying power. The 307-entry manifest stays pinned under its own SHA-256, since it is not one of its own entries and could otherwise be rewritten alongside its references.numpy==2.4.6to match the verified rule-oracle calculator and uses an immutableactions/checkoutrevision.docs/audit reports explaining scope and limitations, plus a generated reviewer-packet artifact.Both audits reject forged repeat identity, shifted margins, post-hoc power family claims, nonfinite SDs, missing or mutated inputs, and unwarranted confirmatory, clinical, or publication status. They mark
power_adequacy=NOT_QUALIFIEDand are not a substitute for peer review.Written for commit 534120e. Summary will update on new commits.