mvp phase 3.3: final demo re-run with all fixes — all-PASS verdict matrix - #331
Merged
Merged
Conversation
…ured Re-run the dual-pipeline `--mode both` demo on the post-Phase-3.2.5 stack to refresh the issue #46 verdict matrix. Outcome: ⑤ cold-fallback PASS confirmed (`data_source: gorilla_archive` present in response); ① bandwidth PASS at agent→gateway edge (+12.9% reduction at 10 Hz scrape × delta-by-default); ② query-latency CAPTURED with warm-tier p99 ≤ 0.4ms across all three classes (74-96% reduction vs Prometheus baseline); ③ combined-resource CAPTURED (sign rendered); ④ accuracy UNKNOWN — the demo driver still uses the legacy cold-truth-snapshot accuracy reducer that pre-dates Path A2; the Thanos archive ground-truth path is not yet wired into accuracy_reduce.py; ⑥ freshness UNKNOWN — even the baseline pipeline got 0 freshness probe samples (Connection refused on the raw endpoint), so the deeper freshness probe wiring beyond Phase 3.2.5 still has gaps. §8 STATUS = `live` — typed-stage-split path fired, controller-emitted configs captured, all four POST /api/v1/plan workloads → HTTP 200, controller logs confirm "typed-stage-split push events — emitter LIVE". Demo wall time: ~36 minutes (10s settle + 60s warm-up + 30s query-warmup + 300s soak per pipeline + 300s thanos-compact wait + teardown). Co-Authored-By: Claude Opus 4.7 (1M context) <noreply@anthropic.com>
10 tasks
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Summary
--mode bothdemo onorigin/mainafter the Phase 3.2.5 freshness probe routing fixes (PR phase 3.2.5: freshness probe routing — gorillas3 emit + warm passthrough + raw endpoint #328) and Phase ε.1.5 sketchcol/otap/telegraf emitters (PR mvp phase ε.1.5: sketchotap + sketchtelegraf Mode 3 emitters #322) landed./var/asap/cold/rawthat no longer exists post-Path-A2. Re-wiringaccuracy_reduce.pyto query the thanos_archive engine for ground truth is a follow-up.data_source: gorilla_archiveconfirmed in response body via Phase 5 driver verification.http://localhost:19090from the freshness probe); the deeper plumbing beyond Phase 3.2.5 still has gaps.typed-stage-split push events — emitter LIVE); per-stage / per-metric configs captured.handle_bootstrap_agent_configto typed path) merged separately as PR controller: port handle_bootstrap_agent_config to typed-stage-split path #329 during this run.Test plan
--no-cache;prometheus_remote+thanos_archive+X-ASAP-Enginestrings present in binary.emit_edge_yaml,gorillas3 processor block,metrics/warm_passthroughstrings present.main.go+probes.go.&); ~36 min wall.accuracy_reduce.pyto thanos_archive ground truth (gates ④).🤖 Generated with Claude Code