Skip to content

Bind physical-plan execution to the authoritative SummaryCatalog - #538

Merged
zzylol merged 30 commits into
mainfrom
feat/query-summary-catalog-bindings
Sep 9, 2026
Merged

zzylol merged 30 commits into
mainfrom
feat/query-summary-catalog-bindings

Conversation

@zzylol

@zzylol zzylol commented Sep 9, 2026

Copy link
Copy Markdown
Contributor

The backend previously carried SummaryCatalog metadata beside parallel runtime definitions, so a successfully installed catalog did not guarantee that SummaryStore instances or QueryPlan readouts used those descriptors. BackendPlan also duplicated ownership already split across precompute, transport, and query plans.

This change completes the catalog-backed physical-plan runtime. The control plane publishes one authoritative SDS catalog snapshot; PrecomputePlan, CollectorPlan, TransmissionPlan, and QueryPlan reference stable materialization IDs; and activation installs the same snapshot into SummaryStore. New SIDs resolve shared SummaryDescriptor and DataDescriptor values from that catalog, while legacy unset identities remain an explicit compatibility path. The backend exposes observed instance inventory from registered state and real in-memory pane coverage at /api/v1/summary-inventory for lifecycle reconciliation.

BackendPlan, its protobuf/install endpoint, duplicate validation, and stale runtime code are removed. Query planning now also consumes the merged ASAPPlanner recursive value-operation DAG, preserving summary children under Sort/Limit TopK and exact binary composition. The data plane executes those nodes through catalog-bound readouts and query-time combination, while unsupported children remain Prometheus fallback boundaries.

Validation:

  • cargo test -p control_plane --lib — 692 passed
  • cargo test -p data_plane --lib — 1,015 passed
  • cargo test -p asap_types — 63 passed
  • cargo check --workspace --all-targets — passed
  • cargo test -p data_plane --test backend_process_e2e --no-run — passed
  • cargo fmt -p control_plane -p data_plane -p asap_types -- --check — passed

@zzylol zzylol changed the title Bind query DAG materializations through SummaryCatalog IDs Install and resolve an authoritative SummaryCatalog snapshot Sep 9, 2026
@zzylol zzylol changed the title Install and resolve an authoritative SummaryCatalog snapshot Complete the SummaryCatalog-backed physical-plan runtime Sep 9, 2026
@zzylol
zzylol force-pushed the feat/precompute-summary-catalog branch from 9b92c18 to a374c0d Compare September 9, 2026 23:04
@zzylol
zzylol force-pushed the feat/query-summary-catalog-bindings branch from 09dbf09 to 84c1f16 Compare September 9, 2026 23:04
@zzylol
zzylol changed the base branch from feat/precompute-summary-catalog to main September 9, 2026 23:06
@zzylol
zzylol force-pushed the feat/query-summary-catalog-bindings branch from 84c1f16 to c6033e2 Compare September 9, 2026 23:07
@zzylol zzylol changed the title Complete the SummaryCatalog-backed physical-plan runtime Bind physical-plan execution to the authoritative SummaryCatalog Sep 9, 2026
@zzylol
zzylol merged commit ccf6de2 into main Sep 9, 2026
1 check passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant