Skip to content

docs(vcrm): record CI evidence for Tier E, mode=te and audit tests (#52) - #75

Merged
amar-python merged 1 commit into
mainfrom
docs/vcrm-ci-evidence
Oct 25, 2026
Merged

amar-python merged 1 commit into
mainfrom
docs/vcrm-ci-evidence

Conversation

@amar-python

Copy link
Copy Markdown
Owner

Closes #52.

#52 asked for the VCRM to show actual CI evidence, with the run ID, for O-07 (Tier E), the mode=te integration tests and the audit-trail tests. Those had only passed locally until #45 was fixed.

Evidence

CI run 40186756039 on main 59aab1a (2026-10-25), integration job against PostgreSQL 16:

  • evals/runner.py --tiers p,i,s,e: 26 of 26 passed, including tier_e/01_envs_have_identical_structure.
  • scripts/test_report.py --strict: 238 collected, 238 passed, 0 failed, 0 skipped.

Since the evidence now exists, the requirements rest on CI. Nothing is downgraded to "verified locally".

Changes to docs/VCRM.md

  • BR-01 and BR-15 notes cite the run.
  • BR-15 matrix row: it still read ❌ "no test asserts it", which contradicted the doc's own summary (19 verified, BR-15 included) and its gap analysis (resolved via S10). The row now shows suite 05 S10 and Tier S 01.
  • By-layer counts: the SQL and Tier S rows are corrected for BR-15.
  • A dated "Confirmed in CI" note is added under the 2026-09-10 changes.

No requirement wording changed. Local checks: Tier P evals 23/23, and the DB-free pytest run gave 118 passed.


Generated by Claude Code

CI run 40186756039 on main 59aab1a (2026-10-25) is the first run in which
the integration job passed: evals P/I/S/E 26/26 including Tier E, and
test_report.py --strict 238/238 with 0 skipped.

- BR-01 and BR-15 notes cite the run.
- The BR-15 matrix row still read 'not verified' although the summary and
  gap analysis counted it verified via assertion S10; the row now shows
  that evidence, and the by-layer counts are corrected to match.

No requirement wording changed.

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
Claude-Session: https://claude.ai/code/session_019YPoXzBSj89ZHgw7nfTmbB
@amar-python amar-python added this to the Verification, tests and CI milestone Oct 25, 2026 — with Claude
@amar-python amar-python added the verification Claim must be verified by execution label Oct 25, 2026 — with Claude
@amar-python
amar-python merged commit b47446a into main Oct 25, 2026
3 checks passed
@amar-python
amar-python deleted the docs/vcrm-ci-evidence branch October 27, 2026 10:46
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

verification Claim must be verified by execution

Projects

None yet

Development

Successfully merging this pull request may close these issues.

VCRM: record CI-unconfirmed evidence (O-07, mode=te, BR-15)

2 participants