Skip to content

fix: ground scorer calibration in added source - #209

Merged
morgaesis merged 3 commits into
mainfrom
fix/scorer-anchor-corpus-20260923
Sep 23, 2026
Merged

morgaesis merged 3 commits into
mainfrom
fix/scorer-anchor-corpus-20260923

Conversation

@morgaesis

Copy link
Copy Markdown
Contributor

Scorer calibration can mistake a numbered change-metadata row for an added source line when metadata appears before source evidence. That synthetic finding has no verifiable source anchor, so qualification stops before the scorer runs. Calibration now selects only fixture diff additions with matching path, line, and bytes, leaving the injection pending until a valid source row appears.

@postil-dev postil-dev Bot left a comment •

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

error 1 blocking finding open
1 finding posted inline

Review details

Comment thread bench/src/scorer-eval.ts Outdated
@morgaesis
morgaesis merged commit 88e7f40 into main Sep 23, 2026
10 checks passed
@morgaesis
morgaesis deleted the fix/scorer-anchor-corpus-20260923 branch September 23, 2026 02:12
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant