Skip to content

Feature: parameter sweeps, batch rerun and side-by-side comparison #379

Closed as not planned

Description

@dkackman

Parameter sweeps ("run at steps 20/30/40", "rerun with prompts A, B, C"), batch rerun, and side-by-side comparison of the results. Today rerun is one job in, one job out, with no grouping. Scoping notes against audit finding U6, including whether to reuse previous_result's cartesian expansion.

Design: sweeps-and-comparison.md. Its own status says nothing should be built without a fresh look at whether it's still worth the cost.
Rank: todo.md Tier 3: a new job-schema field, batch semantics and a new UI page.

Parked (owner:don + status:needs-approval) as backlog. Starting it means handing it to the feature lead (harnest roadmap R11), which designs with Don in this thread before any code.

Migrated from docs/proposals/ by claude-opus-5-5 via anthropic, in an interactive session with Don. The design doc is linked at develop@c1e103b; it stays authoritative until a plan here supersedes it.

Activity

  1. added
    owner:donParked for human decision
    status:needs-approvalParked pending a written proposal + human approval
    featureWork bigger than a fix: designed with Don, built in stages (harnest R11)
    priority:3Backlog rank: high benefit, big lift
    on Sep 23, 2026
  2. dkackman commented on Sep 27, 2026

    @dkackman
    OwnerAuthor

    Closing wontfix — no live pain has forced this since it was parked, and the design doc itself says nothing should be built without a fresh look at whether it's worth the cost (a new job-schema field, batch semantics, and a new UI page). Bring it back if a real use case shows up.

  3. added
    wontfixThis will not be worked on
    and removed
    owner:donParked for human decision
    status:needs-approvalParked pending a written proposal + human approval
    on Sep 27, 2026
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

No one assigned

    Labels

    featureWork bigger than a fix: designed with Don, built in stages (harnest R11)priority:3Backlog rank: high benefit, big liftwontfixThis will not be worked on

    Projects

    No projects

      Milestone

      No milestone

      Relationships

      None yet

      Development

      No branches or pull requests

      Issue actions