Leaderboard: Aug batch — Paix2 #1, Sqwish/BARouter updates, Divyam, nadir-caliper, AsiaInfo - #184
Merged
Merged
Conversation
… nadir-caliper (#173), BARouter update (#180), AsiaInfo (#181) - Paix2 (#164): new 🥇 arena 77.63 / acc 79.69% / $0.27 - Sqwish update (#177): 🥈 75.27 -> 76.21 (sqwish-fvcta8 pool) - Divyam (#175): new 🥉 arena 75.85 / acc 78.59% - nadir-caliper (#173): 74.55, supersedes Nadir-Tumbler (73.44) - BARouter update (#180): 67.09 -> 73.79 - AsiaInfo (#181): arena 65.87 (high-cost 2-model) All audited: 8400 unique rows, real tokens, faithfulness gaps within trusted band. Co-Authored-By: Claude Opus 4.8 <noreply@anthropic.com>
|
Hi @yl231, thank you for putting this batch together. Since this is the leaderboard update that added Paix2 at #1, I wanted to link #190 here so it does not get missed. The issue documents a specific question in #164's history: the July 27 revision changed 294 of 809 Whenever you have a moment, I would really appreciate your eyes on it. Thank you. |
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
2 participants
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Maintainer leaderboard update for the six submissions merged today (#164 #177 #175 #173 #180 #181).
nadir-caliper supersedes Nadir-Tumbler. Manifest updated; website sync will regenerate derived data.