NuminaMath — LLM Reasoning Dataset
860K competition and olympiad-level math problems with curated, structured solutions. Created for the AI Mathematical Olympiad challenge, NuminaMath represents the frontier of mathematical reasoning datasets, covering AMC, AIME, and international olympiad problems.
Dataset Details
| Provider | AI-MO |
| Category | Reasoning |
| Size | 860K Problems |
| License | Apache 2.0 |
| Downloads | 520k |
| Tags | Olympiad Math, Competition, Chain-of-Thought, AIMO, 2024 |
from datasets import load_dataset
ds = load_dataset("AI-MO/NuminaMath-CoT")
Fine-tune with this dataset
Estimated VRAM to fine-tune with QLoRA (4-bit base model + LoRA adapters), using conservative defaults:
| 7B QLoRA | ~6GB VRAM |
| 13B QLoRA | ~10GB VRAM |
Check if your GPU can fine-tune this →
New to fine-tuning? Follow the step-by-step walkthrough: Fine-Tune Your First LLM in 1 Hour
Related datasets
- MetaMathQA — Boosting GSM8K/MATH-style math skills in 7B models
- OpenThoughts3-1.2M — Distilling strong math/code/science reasoning into 7B–32B models
- Orca Math Word Problems — Grade-school math word problems for small models
- s1K-1.1 — Cheap, fast reasoning fine-tunes — 1k samples means minutes of training, not days
Frequently asked questions
Can I use NuminaMath commercially?
Yes — NuminaMath is released under Apache 2.0, a permissive license that allows commercial use, including training models you ship in a product. Check the dataset card for attribution requirements before release.
How much data does NuminaMath contain, and do I need all of it?
NuminaMath contains 860K Problems. You rarely need all of it: for style and format fine-tuning, a few hundred to a few thousand examples are enough — load a slice (e.g. split="train[:1000]") and scale up only if quality plateaus.
What is NuminaMath best used for?
Chain-of-thought math fine-tuning up to olympiad level. It belongs to the Reasoning section of our dataset hub, where you'll find alternatives and complementary sets.
← All datasets | Fine-Tuning Guide