Skip to content

[Sad Catapella B8][Performance] Notebook plan rebuild repeatedly stats every TIFF and reparses the manifest on settings edits #102

Open

Description

@guijacquemet

Basis

Batch 8 at d7a538e56d41ac1093ba79adcad397c21b3dfd32. Confirmed repeated I/O access pattern, latency impact is a benchmark hypothesis.

Evidence

Fix / acceptance

Cache manifest header/count for the current output folder until output path changes or the run publishes new outputs; cache source sizes and conversion estimates keyed by validated preflight snapshot plus pyramid settings (never cache across a new preflight); update only threshold-dependent text when unrelated controls change. Account explicitly for acquired files changing during a session (Batch 5 #90): preview is advisory, final run always revalidates sources. Benchmark 100, 1k, 10k and 100k TIFFs, 10 rapid settings changes, local/remote storage, wall time, stat calls and peak RSS; ensure identical plan text and invalidation. Numba not appropriate.

Activity

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    No projects

      Milestone

      No milestone

      Relationships

      None yet

      Development

      No branches or pull requests

      Issue actions