Skip to content

Execute ClickHouse joins in the shared query DAG - #569

Merged
zzylol merged 2 commits into
mainfrom
feat/unified-clickhouse-relational-join
Sep 10, 2026
Merged

zzylol merged 2 commits into
mainfrom
feat/unified-clickhouse-relational-join

Conversation

@zzylol

@zzylol zzylol commented Sep 10, 2026

Copy link
Copy Markdown
Contributor

ClickHouse ratios and equi-joins whose inputs have selected summaries now execute as an ordinary RelationalJoin node in the shared, language-neutral QueryPlan DAG. Both branches reference SummaryDefinitionId entries in the authoritative catalog; the runtime reads each summary subtree and combines typed relations before projection.

The Planner dependency advances to the current relational IR stack. Unsupported join shapes retain external exact fallback. No ClickHouse plan catalog, sidecar, or ExecutableQueryPlan is introduced.

Validation:

  • CARGO_INCREMENTAL=0 cargo check -p data_plane --lib -j 1
  • CARGO_INCREMENTAL=0 cargo test -p data_plane --lib asap_clickhouse_query_engine --no-fail-fast -j 1 (11 passed)

@zzylol
zzylol force-pushed the feat/unified-clickhouse-temporal-bindings branch from 0b30c85 to de4b712 Compare September 10, 2026 14:13
@zzylol
zzylol force-pushed the feat/unified-clickhouse-relational-join branch 2 times, most recently from 8a176f5 to d87bfbb Compare September 10, 2026 14:13
@zzylol
zzylol force-pushed the feat/unified-clickhouse-temporal-bindings branch from de4b712 to c24a40f Compare September 10, 2026 14:16
@zzylol
zzylol force-pushed the feat/unified-clickhouse-relational-join branch from d87bfbb to 74fa720 Compare September 10, 2026 14:16
@zzylol
zzylol force-pushed the feat/unified-clickhouse-temporal-bindings branch from c24a40f to 6ca2965 Compare September 10, 2026 14:29
@zzylol
zzylol force-pushed the feat/unified-clickhouse-relational-join branch from 74fa720 to 3b15697 Compare September 10, 2026 14:29
@zzylol
zzylol force-pushed the feat/unified-clickhouse-temporal-bindings branch from 6ca2965 to 63ada7b Compare September 10, 2026 14:30
@zzylol
zzylol force-pushed the feat/unified-clickhouse-relational-join branch 2 times, most recently from 1582453 to 0642263 Compare September 10, 2026 14:35
@zzylol
zzylol force-pushed the feat/unified-clickhouse-temporal-bindings branch from 63ada7b to 744cee3 Compare September 10, 2026 14:35
@zzylol
zzylol changed the base branch from feat/unified-clickhouse-temporal-bindings to feat/unified-clickhouse-query-plan September 10, 2026 14:36
@zzylol
zzylol force-pushed the feat/unified-clickhouse-temporal-bindings branch from 744cee3 to b70791f Compare September 10, 2026 14:36
@zzylol
zzylol force-pushed the feat/unified-clickhouse-relational-join branch from 0642263 to ef763e0 Compare September 10, 2026 14:36
@zzylol
zzylol force-pushed the feat/unified-clickhouse-query-plan branch from b70791f to 213a3c1 Compare September 10, 2026 14:44
@zzylol
zzylol force-pushed the feat/unified-clickhouse-relational-join branch 2 times, most recently from bdd39bd to bf1ba25 Compare September 10, 2026 14:47
@zzylol
zzylol force-pushed the feat/unified-clickhouse-query-plan branch 2 times, most recently from 453c7cc to 35bf3ed Compare September 10, 2026 14:51
@zzylol
zzylol force-pushed the feat/unified-clickhouse-relational-join branch 3 times, most recently from 168195a to 300d7f0 Compare September 10, 2026 15:00
@zzylol
zzylol force-pushed the feat/unified-clickhouse-query-plan branch from 35bf3ed to cb8a0f4 Compare September 10, 2026 16:17
@zzylol
zzylol force-pushed the feat/unified-clickhouse-relational-join branch from 300d7f0 to c752ab4 Compare September 10, 2026 16:17
@zzylol
zzylol force-pushed the feat/unified-clickhouse-query-plan branch from cb8a0f4 to 353f497 Compare September 10, 2026 17:09
@zzylol
zzylol changed the base branch from feat/unified-clickhouse-query-plan to main September 10, 2026 17:15
@zzylol
zzylol force-pushed the feat/unified-clickhouse-relational-join branch from c752ab4 to fec0c51 Compare September 10, 2026 17:18
@zzylol
zzylol merged commit c6b37bd into main Sep 10, 2026
1 check passed
zzylol added a commit that referenced this pull request Sep 10, 2026
* Add costed sliding-window materialization layouts (#580)

* Execute selected sliding window layouts in workers (#583)

* Execute ClickHouse joins in the shared query DAG (#569)

* feat(clickhouse): execute SQL joins in the shared query DAG

* fix: consume canonical planner lifecycle contract

* fix(clickhouse): validate each join input coverage

* chore: pin merged planner join contract
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant