knowledge: improve review precision from BCApps PR 11063 feedback - #162
Open
Wenjie Fan (gggdttt) wants to merge 1 commit into
Open
Wenjie Fan (gggdttt) wants to merge 1 commit into
Wenjie Fan (gggdttt) wants to merge 1 commit into
Conversation
Wenjie Fan (gggdttt)
requested review from
Bardur Knudsen (BardurKnudsen) and
Bugsy (pchriste-microsoft-com)
as code owners
September 8, 2026 08:10
Jesper Schulz-Wedde (JesperSchulz)
requested changes
Sep 15, 2026
Jesper Schulz-Wedde (JesperSchulz)
left a comment
Contributor
There was a problem hiding this comment.
Two changes are necessary before this precision rule can land:
- The supplied exact regression still fails: the candidate generates 1 unexpected finding for
synthetic__perf-watermark-folder-sync-01(expected 0, F1 0). It only reduces the original two false positives to one. Please resolve the remaining deterministic route/evaluator result, or correct the fixture/gold if that remaining finding is independently valid, then rerun to a clean result. - This stale branch no longer passes the current exact-tree contract. Merging it with current
main(852a676; computed merge treebd8b8f4) makestools/Test-ReviewFixtures.ps1fail: both companion samples are code spans rather than READ-convention links. Use[filename.good.al](filename.good.al)and the equivalent.bad.allink.
I traced BCApps #11063's thumbs-down and replies: the conditional rule is otherwise correct—the received-time watermark is unsafe when older items can become newly visible, while a server-side processed-state filter prevents those items consuming $top; monotonic change/delta tokens remain explicitly excluded. The AL examples preserve that boundary, [all] is appropriate, current checks and exact-head frontmatter/index/34-fixture validation pass, and current-main merged-tree frontmatter/index validation passes. The merged-tree fixture failure and unresolved 1/1 false positive are the blockers.
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Summary
Improves BCQuality knowledge based on maintainer thumbs-down feedback from explicit BCApps PR review runs.
Source feedback
Validation
Generated by the BC-ALAgentsInternal self-improvement workflow.
Offline evaluation: regression
Candidate correctness failed: unexpected or missed findings remain. Existing ignored gold comments retain their neutral scoring semantics.
Common engine code:
ecf8e31759d6ddd6d78e3a0b7836b40134368009; dataset SHA256:ACDC50C36CC88DD31A5AB628A7C3D06A44E5F7628DA9DA79A0916E6AF0F46222.Model:
gpt-5.6-luna; judge:gpt-5.3-codex. Exact D:synthetic__perf-watermark-folder-sync-01.Dataset base:
231538937b19317eddc3ac654459ca29b3ef4170; candidate:46b6ad94497fcb272417b170b2cbb7b3f96d7209.27da12f4d5dfec9862f23219b9d1e80c465cc18a4407f20b44fe92e3693d0444d25cc3430f1d52628584217c7506eea7eef27a9db353d78c0cd6a9a109695a2fecf379e823762ccbc425a09b9259a82335b7bcdecf431b9b1a18ca83830a38c2fc353344e74e2a6601ec87a1ffec6e3d7eb074aa67437ef2Baseline
Run: https://github.com/microsoft/BC-Bench/actions/runs/34221111997; conclusion: success; wall clock: 12.6 minutes.
Raw findings and runtime pin proofs are retained in the self-improvement-feedback artifact and the linked evaluation run.
synthetic__perf-watermark-folder-sync-01Observed AI credits: unavailable; coverage 0/1 entries. Missing entries are not extrapolated into a total.
Candidate
Run: https://github.com/microsoft/BC-Bench/actions/runs/34222250479; conclusion: success; wall clock: 7 minutes.
Raw findings and runtime pin proofs are retained in the self-improvement-feedback artifact and the linked evaluation run.
synthetic__perf-watermark-folder-sync-01Observed AI credits: unavailable; coverage 0/1 entries. Missing entries are not extrapolated into a total.
Missing telemetry is unavailable, not zero. Evaluation-only metrics exclude candidate generation and are not the full-cycle cost.
Human review must verify source-patch fidelity, gold correctness, and target attribution. No automatic merge or branch-protection claim is made.