OpenCodeReasoning — LLM 推理 Dataset

The largest open reasoning dataset for code: 735,255 Python samples distilled from DeepSeek R1 across 28,319 unique competitive-programming problems from CodeForces, LeetCode, AtCoder, and more. SFT-only training on it reached 61.8% on LiveCodeBench — beating RL-trained alternatives. Predominantly CC BY 4.0 with some Apache 2.0/MIT-sourced subsets.

Dataset Details

from datasets import load_dataset
ds = load_dataset("nvidia/OpenCodeReasoning")

用这个数据集微调

使用 QLoRA（4-bit 基础模型 + LoRA 适配器）微调的预计显存需求（保守默认参数）：

检测你的 GPU 能否微调 →

微调新手？跟着分步教程走： 一小时微调你的第一个 LLM

相关数据集

• OpenThoughts3-1.2M — Distilling strong math/code/science reasoning into 7B–32B models
• The Stack v2 — Pretraining code models across 600+ programming languages
• MetaMathQA — Boosting GSM8K/MATH-style math skills in 7B models
• Orca Math Word Problems — Grade-school math word problems for small models

常见问题

← 全部数据集 | Fine-Tuning Guide