We are a non-profit research lab focused on understanding and building better Korean language models. See below for an overview of our projects.
Benchmarks
We have built the most-widely used korean benchmarks including HAE-RAE Bench (cultural knowledge, dataset, paper),
KMMLU (general knowledge, dataset, paper), HRM8K (math, dataset, paper), KMMLU-Redux/Pro (general knowledge, dataset, paper), and HAERAE-VISION (vision-language, dataset, paper)).
Evaluation
We developed the haerae-evaluation-toolkit, a unified LLM evaluation framework designed to provide consistent and reproducible benchmarking for Korean and multilingual models.
Reasoning Language Models
With cooperation with KISTI-KONI we released the KO-REAson series, <10B reasoning language models trained for Korean.
2025.01.08: We release HAERAE-VISION, Korean real-world VLM benchmark 🔥🔥🔥
2025.08.31: We release six KO-REAson-0831 models 🔥🔥🔥
2025.07.11: We've collaborated with LG AI Research to build KMMLU-PRO an major update to our KMMLU franchise.
2025.01.05: We are releasing the first public korean math (📐e = ∑∞ⁿ⁼⁰ ¹ₙ🤓) benchmark HRM8K
