Skip to content

docs(eval): Fig 7 query-latency CDF — warm p50 18.3ms/p99 20.0ms (real gct) - #493

Merged
zzylol merged 1 commit into
mainfrom
docs/fig7-latency
Jun 12, 2026
Merged

zzylol merged 1 commit into
mainfrom
docs/fig7-latency

Conversation

@zzylol

@zzylol zzylol commented Jun 12, 2026

Copy link
Copy Markdown
Contributor

Folds the measured query-latency (Fig 7) results into docs/evaluation-plan-figures.md.

Warm-tier sketch PromQL is production-usable. Real Google-2019 trace, cold-OFF stack, wall-clock-anchored, 599-query mix @15 QPS, guard-verified before timing (DDSketch read returned 691 real warm series; sum=exact GT 216.3535; all data_source=asap_query; 0 empties/errors).

query kind p50 p95 p99 n
all (mix) 18.25 19.45 20.03 ms 599
quantile_over_time (DDSketch, 691-series) 18.34 19.56 20.65 ms 400
sum (lossless) 1.58 2.19 2.25 ms 199

Bimodal CDF: lossless sum ~1.5–2.3 ms; 691-series DDSketch quantile reconstruction ~18–21 ms; tight tails.

Honest caveats: cold-fallback arm attempted but blocked (cold ship rides the disabled control channel → MinIO empty, old-ts queries still served warm) → warm-only reported, not faked. Single-node loopback (server-side latency only, no network RTT). count_over_time excluded (does not resolve on warm path).

Eval artifacts on branch feat/query-latency-cdf: datasets_eval/latency/.

🤖 Generated with Claude Code

… (real gct)

Fold the measured query-latency results into the eval plan: warm sketch-answered
PromQL is production-usable (overall p50 18.25ms / p99 20.03ms across a 599-query
mix @15 QPS on the real cold-OFF stack, guard-verified). Bimodal CDF — lossless
sum ~1.6ms vs 691-series DDSketch quantile reconstruction ~18-21ms, tight tails.
Cold-fallback arm honestly marked blocked (cold ship rides the disabled control
channel); warm-only, single-node loopback (no network RTT).

Co-Authored-By: Claude Opus 4.8 (1M context) <noreply@anthropic.com>
@zzylol
zzylol merged commit 68dfa63 into main Jun 12, 2026
@zzylol
zzylol deleted the docs/fig7-latency branch June 12, 2026 21:23
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant