Repository navigation
fix(stats): use capability fallbacks in comparison radar - #51161
Merged
Merged
Conversation
adamdotdevin
changed the title
3 tasks done
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
1 participant
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Missing benchmarks currently collapse radar axes to zero, and Muse Spark contributor IDs fail to resolve their lab metadata.
Use a 50/100 baseline for supported reasoning and tool calling when comparable benchmarks are unavailable, and neutral 50/100 placeholders for other missing values. Explicitly unsupported capabilities stay at zero; measured scores take priority. Hollow markers, tooltips, and accessible descriptions identify every fallback. Resolve known Muse contributor tiers to their lab metadata while preserving contributor pricing and excluding aliases from normalization populations.
Validation: 5 regression tests,
bun typecheck, andbun run buildpass inpackages/stats/app. Browser-checked the actual component on desktop and 390px mobile with measured, partial, and missing data, including tooltip labels and unknown versus unsupported capability parsing. Preview uses the catalog from anomalyco/models.dev#8028. Full SST-linked page verification remains blocked by missing Cloudflare credentials; not deployed.Windows CI failed before tests with Bun 1.3.14
ENOTEMPTYduring package patching (also present on the base branch). Use Bun 1.4.2 on Windows, which includes oven-sh/bun#33646, remove the old hoisted-linker workaround, and include Bun version in dependency-cache keys. Linux/macOS retain the repository-pinned version. Validated version selection for Windows x64/ARM64, Linux x64, and macOS ARM64.