Skip to content

Execute completed cohorts at every materialized maintenance frontier - #665

Merged
zzylol merged 9 commits into
mainfrom
feat/maintenance-multi-frontier
Sep 11, 2026
Merged

zzylol merged 9 commits into
mainfrom
feat/maintenance-multi-frontier

Conversation

@zzylol

@zzylol zzylol commented Sep 11, 2026

Copy link
Copy Markdown
Contributor

Why

A synchronized immutable input cohort needs to execute each installed materialized frontier without reusing the first source's state.

What

Teach the existing registry and completed-input entry point to consume one complete population per source definition at matching full windows.

How

One Live/Frozen input representation resolves each bound definition. The cohort entry validates the exact source map, common labels, shared window contract, and each source's finite singleton proof before computing or recovering output. It uses the existing full-cohort lineage and atomic publication transaction.

Before this PR

Execution supplied one source to every eligible materialized input.

After this PR

A bound two-source operator graph can merge exact sums, finalize, and update its configured sketch with all inputs. Single-source execution delegates to the same entry point.

Verification

12 actual-sketchlib-139 maintenance tests passed. A bound operator fixture computes 2 + 7 = 9 through SumMerge→Finalize→KLL, rejects execution before closure without output, publishes once, and does not add parts on retry or restart. This fixture is not a frontend selection or performance claim.

Limits

Automatic installation/scheduling still retains its single-source gate pending a real selected-plan integration. Multiple populations per frontier, cross-group routing, continuous watermarks, and sliding execution remain later work. Includes the already-reviewed shared window helper from #661; depends on #662 and #664.

@zzylol
zzylol changed the base branch from feat/maintenance-cohort-publication to main September 11, 2026 18:44
@zzylol
zzylol marked this pull request as ready for review September 11, 2026 18:45
@zzylol
zzylol merged commit 2283943 into main Sep 11, 2026
1 check passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant