Skip to content

[Sad Catapella B5][Performance] Repeated linear manifest lookups make unchanged runs quadratic in file count #91

Open

Description

@guijacquemet

Baseline / classification

Adversarial audit Batch 5 at d7a538e56d41ac1093ba79adcad397c21b3dfd32. Confirmed asymptotic inefficiency, runtime slowdown unmeasured.

Evidence

Fix / benchmarks

Create an immutable path→FileEntry lookup once (or explicitly build one per batch from the manifest) and use it consistently in run and source checks, with duplicate-path validation. Preserve existing RunManifest JSON schema/order. Benchmark 100, 1k, 10k, 100k images in a no-change rerun and check_sources; compare slope/latency and memory overhead. The iterator/tuple public interface can remain unchanged. Numba is not suitable: Python dictionary indexing removes the algorithmic problem.

Activity

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    No projects

      Milestone

      No milestone

      Relationships

      None yet

      Development

      No branches or pull requests

      Issue actions