You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
A short, cheap benchmark that measures difficult capabilities: 42 generated items, 75 points across 8 categories. 60 points graded deterministically, 15 by a pinned open-weight judge. Answers are computed from a seed rather than stored, so the repository is the whole artifact.
The specification behind ESAC, a program of compact benchmarks that measure difficult capabilities without measuring budget. ESAC-GI is released and runnable; ESAC-AG has a harness and one of its seven categories. Items are generators rather than stored questions, and every score carries the version tag of the instrument that produced it.