docs: AEP tutorial; upstream report and following-upstream skill; verify aep 0.64.0 / ess 0.39.0; release 0.18.0 - #49
Merged
Merged
Conversation
…w stories - project.yaml `protocols:` pins the aep 0.64.0 release commit 58433bd (was b857bbe), as the aep maintainers asked; validate: valid. - story:shared-docs-toolchain implemented: the bundle workflow pins docs-system 339b4b8, which contains the 1d4c026 the story named (merge-base --is-ancestor); evidence the bundle run 36406238132 on 44bb0ee. - dependency-blocker:governed-dogfood-run blocks story:drive-entry-skill: the aep story it waits on is draft on beyond10x/aep main (b11db55). - New active stories with scope: story:aep-tutorial (a public AEP tutorial on the ESS tutorial's library) and story:docs-manifest-links-resolve (the check that would have stopped the four-day publication outage).
- verified.json pins aep 0.64.0 (was 0.63.1) and ess 0.39.0 (was
0.38.0). agentplugins-check tools: aep 141, ess 43, worktree 19
spelled commands; the ESS tutorial's spec, suite and go test pass on
0.39.0. No plugin text spells the removed `protocol` binary.
- Trial round: ess-new 14 tool calls, ess-pipeline 10, ess-full-package
51 (15/15 go test), ess-tutorial 38 (17/17), aep-backlog 314, all
within the baseline. ess-retrofit first regressed (8 refusals): the
agent modelled GET /tools/{id} as a view filtered `id == param.id`,
which synthesis cannot bind (ESS-SYNTH-005, same on 0.38.0). With the
identity filter removed the same spec gives 20 scenarios and 0
refusals; the rerun with the fix below gave 25 and 0.
- ess:retrofitting and syntax.md: a read by identity is the unfiltered
view with a comment; never `filter: id == param.id`. Filed with the
link-field gap as beyond10x/ess#193.
- ess:hardening: ExploreConcurrent / exploreConcurrent and
`ess verify conform check-history` (ess 0.39.0) for services that take
concurrent calls.
- Every section URL under a surface's canonicalUrl maps to website/docs/<path>.md or <path>/index.md, or the check fails naming the manifest line. From 2026-09-24 to 2026-09-28 every Atlas "Publish unified documentation" run failed on the one link this would have caught (plugins/beyond10x/, renamed in 0.14.0), and the public site stayed on its 2026-09-24 publication. - Test a_docs_manifest_link_to_a_missing_page_fails_the_check; on the real manifest with the old URL restored the check prints "b10x.docs.yaml:65 links .../plugins/beyond10x/, and website/docs/ has no plugins/beyond10x.md".
… the epic's objective Two findings from recording the AEP tutorial (2026-09-28, aep 0.64.0): - Two of the four plan critics returned their verdict off line 1 (design put it last; parallel-safety wrote `approve — …`), although each procedure and critic-rubric.md say line 1 is exactly the verdict. aep:planning section 7 now has the recorder check line 1 and send a malformed reply back once before recording it. - Accepting the six drafted stories was refused: "story:... is proposed and serves no objective" (development.standard). The decomposer now relates each story `serves:` the epic's objective at creation.
- `agentplugins-check upstream` (network) prints what moved in every repository this one depends on: the aep, ess, worktree, metaharness and connectors releases against their pins (verified.json, eval.yml, the integrating skill) with the CHANGELOG sections since each pin; every `uses: beyond10x/<repo>/...@<commit>` against that repository's main; and the state of every beyond10x/<repo>#<n> cited in plugins/ and website/docs/. It reports and fails only when it cannot read. - First run: connectors v0.7.2 -> v0.13.3 (the v1 line is deliberate, an operator decision); docs-system, gates and website pins behind main (Atlas-generated files, moved by Atlas); aep#60 and ess#186 open. A `git+...#<commit>` locator was first read as issue aep#8; issue numbers now need a word boundary, with a test. - New .agents/skills/following-upstream (linked for Claude Code): detect with the report, sort each changelog entry, update, verify with tools and a trial round before verified.json moves, release, then the website Start page pins and the next Atlas publication. - AGENTS.md: map row and gate line.
- The flat-spelling gate read "an ess release" as the retired verb `ess release` (now `ess generate release`); the two sentences say "a new release of ess" instead.
…itic cases - aep 0.64.0 moved live evaluation: `aep drive eval run` without --stream prints "live evaluation moved to `metaharness aep drive eval run`". The corpus README, every recorded/README.md and eval.yml now spell the metaharness command; eval.yml pins aep 0.64.0 and metaharness 0.8.0 (were 0.44.0 and 0.4.2) and installs the metaharness-cli package. Recorded READMEs name plugins/aep, not the retired plugins/aep-plan and plugins/aep-drive. - Recording is blocked: metaharness 0.8.0 and its main link aep 0.55.0 and refuse every case with EVAL-RUN-017 beside aep 0.64.0 (observed on the four plan-critic cases). Filed beyond10x/metaharness#10; dependency-blocker:metaharness-links-aep-0-55 blocks story:plugin-eval-cases. - fixtures/library-reservations-drafted: the AEP tutorial's library at the commit before its critics ran (epic:book-reservations, six draft stories), outside evals/ because the corpus refuses a directory that is not a case. The four plan-critic cases now name epic:book-reservations and that fixture as their working tree; `aep plan artifact validate` on a Git copy: valid, 10 artifacts.
- New website/docs/tutorials/first-governed-plan.md continues the ESS tutorial's library with AEP: install, adopt a /5 store, ask for reservations (nine numbered questions, answered "defaults"), the specification extended first (17 -> 55 scenarios, 0 refusals), an epic and six stories, four critic verdicts, a wave proposal, and the first story implemented, adversary-reviewed and merged. - Every output is a real run on 2026-09-28 with aep 0.64.0, ess 0.39.0 and plugins 0.17.0 in an isolated sandbox, one claude -p session resumed across five prompts (plan and critics $5.48, acceptance $6.34, wave $13.19). Recorded outputs include `aep plan artifact waves` (5 waves, 20 collisions), `explain` on the implemented story (the adversary outcomes, the 10/17 -> 17/17 verification, the gate on the merge), the board and the git graph. - The validate warnings on the four review records are aep#60, named on the page. - Sidebar Tutorials category, intro, b10x.docs.yaml guide section; the ESS tutorial's closing section links it (its trial fixture copies the page again).
…s run differed
- trials/aep-tutorial: a fresh isolated agent gets the ESS tutorial's
library (fixture) and a copy of first-governed-plan.md and works steps
2-6. First complete run (aep 0.64.0, ess 0.39.0, plugins at this
branch): /5 store, spec 17 -> 55 scenarios with 0 refusals, epic and
six stories, four critic approvals (the scope critic sent back once
under the new line-1 rule), reservations-suite-baseline implemented,
adversary-reviewed and merged, final go test ok; 474 tool calls,
$12.41. Baseline: tool calls, synthesis, outputs. validate and
go_test are not measured: the wave's adversary makes red runs on
purpose, and the report reads the last run it saw.
- The page, from that run's list of differences: ids, counts and wording
differ between runs (said once at the top); the validate output is
labelled as taken after the wave; the `serves no objective` refusal is
this recording's, the decomposer now prevents it; who declares a
story's scope (aep:story-scoper) and what to do when `waves` finds
none; the plan's branch becomes the wave's base; the worktree plugin
as the alternative to plain git worktrees.
- trials.rs: trial kind aep-tutorial; the page-copy test covers both
tutorials.
- Taskfile trial:sandbox makes a sandbox writable before removing it:
aep's protocol snapshots are read-only, so a sandbox that ran aep
could not be recreated ("rm: cannot remove ... Permission denied").
- Workspace, all ten plugin manifests and the Skill version lines move to 0.18.0; CHANGELOG gains the 0.18.0 section. task check: exit 0. agentplugins-check tools: exit 0 (aep 0.64.0: 149, ess 0.39.0: 45, worktree 0.8.2: 19 spelled commands; the ESS tutorial's spec, suite and go test pass). Trials: ess-new, ess-retrofit (after the identity-view fix), ess-pipeline, ess-full-package, ess-tutorial and aep-backlog within the baseline; aep-tutorial complete, baseline recorded.
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
chore(plan)protocols:at aep 0.64.0;shared-docs-toolchainimplemented; blocker ondrive-entry-skill; storiesaep-tutorial,docs-manifest-links-resolvedocs(ess)verified.jsonaep 0.64.0, ess 0.39.0; identity-filtered views (beyond10x/ess#193); concurrent explorer iness:hardeningfeat(check)b10x.docs.yamllink must name a page (the link that failed every website publication 2026-09-24 → 28)docs(aep)servesthe epic's objectivefeat(check)+docs(skills)agentplugins-check upstream;.agents/skills/following-upstreamtest(evals)metaharness aep drive eval run;fixtures/library-reservations-drafted; blocked on beyond10x/metaharness#10docs: tutorialtutorials/first-governed-plan.md, a real recorded runtest(trials)aep-tutorialtrial; page fixes;trial:sandboxremoves read-only aep snapshotschore: release 0.18.0Gates run locally:
task check: exit 0.agentplugins-check tools: exit 0 (aep 0.64.0 149, ess 0.39.0 45, worktree 0.8.2 19 commands; ESS tutorial spec, suite and go test).task site-build: exit 0.aep-tutorialcomplete (story implemented and merged, final go test ok), baseline recorded.