Pretraining Data
updated
opencsg/Fineweb-Edu-Chinese-V2.1
Preview • Updated • 44.1k
• 81
Viewer • Updated • 28.9B • 16.8k
• 42
Viewer • Updated • 3.8B • 31.8k
• 147
allenai/dolma3_dolmino_pool
Updated • 25.9k
• 9
allenai/dolma3_longmino_pool
Updated • 4.02k
• 14
Viewer • Updated • 476M • 80k
• 957
Viewer • Updated • 4.48B • 167k
• 936
Viewer • Updated • 61.6M • 18.6k
• 345
Viewer • Updated • 819M • 999
• 14
tokyotech-llm/swallow-code-v2
Viewer • Updated • 147M • 15.6k
• 63
ByteDance-Seed/Code-Contests-Plus
Viewer • Updated • 70.1k • 11.9k
• 70
Viewer • Updated • 7.09M • 11.3k
• 201
nvidia/Nemotron-Pretraining-Code-v2
Viewer • Updated • 836M • 4.8k
• 139
nvidia/Nemotron-Pretraining-Specialized-v1
Viewer • Updated • 60.7M • 10.1k
• 91
nvidia/Nemotron-CC-Math-v1
Viewer • Updated • 190M • 8.87k
• 103
nvidia/Nemotron-Pretraining-SFT-v1
Viewer • Updated • 299M • 2.62k
• 74
Viewer • Updated • 1.86M • 10.3k
• 264
EssentialAI/essential-web-v1.0
Preview • Updated • 164k
• 255
EssentialAI/eai-taxonomy-stem-w-dclm
Preview • Updated • 4.87k
• 6
EssentialAI/eai-taxonomy-med-w-dclm
Viewer • Updated • 81.2M • 1.03k
• 8
EssentialAI/eai-taxonomy-code-w-dclm
Viewer • Updated • 274M • 10.8k
• 11
EssentialAI/eai-taxonomy-math-w-fm
Viewer • Updated • 21.6M • 336
• 5
Viewer • Updated • 27.9B • 212
• 7
DataMuncher-Labs/UltiMath
Viewer • Updated • 32.9B • 23.8k
• 46
HuggingFaceFW/finetranslations
Viewer • Updated • 3.33B • 16k
• 310
Viewer • Updated • 69.9k • 241k
• 449
JetBrains-Research/commit-chronicle
Viewer • Updated • 10.9M • 3.62k
• 14
ASSERT-KTH/repairllama-datasets
Viewer • Updated • 460k • 97
• 3
Updated • 20.1k
• 82
Viewer • Updated • 778k • 49
• 1
Viewer • Updated • 3.5M • 318
nick007x/github-code-2025
Viewer • Updated • 148M • 6.5k
• 122
tokyotech-llm/swallow-code
Viewer • Updated • 129M • 5.07k
• 84
macrocosm-os/code-parrot-github-code
Viewer • Updated • 115M • 369
• 13
nyuuzyou/google-code-archive
Viewer • Updated • 65.8M • 2.89k
• 74
ad6398/Deepmind-CodeContest-Unrolled
Viewer • Updated • 13.2M • 108
• 2
datablations/python-megatron
Updated • 4.17k
• 1
nomic-ai/cornstack-python-v1
Viewer • Updated • 23.6M • 1.18k
• 28
Viewer • Updated • 22.6M • 13.2k
• 1
Viewer • Updated • 552k • 320
utter-project/github-code-2025-above-2-stars
Viewer • Updated • 103M • 658
• 4
tokyotech-llm/swallow-math-v2
Viewer • Updated • 17.4M • 8.9k
• 37
Viewer • Updated • 181M • 25.5k
• 365
Viewer • Updated • 513k • 83
• 8
Updated • 1.27k
• 1
Preview • Updated • 77.4k
• 105
CodedotAI/code_clippy_github
Viewer • Updated • 2.4M • 6.91k
• 20
Lichess/standard-chess-games
Viewer • Updated • 7.14B • 223k
• 121
jablonkagroup/chempile-mlift
Viewer • Updated • 51.5M • 10.4k
• 14
Viewer • Updated • 49.8M • 40
jablonkagroup/chempile-code
Viewer • Updated • 2.27M • 317
• 5
jablonkagroup/chempile-paper
Viewer • Updated • 11.7M • 771
• 8
jablonkagroup/chempile-education
Viewer • Updated • 66.9k • 492
• 9
Viewer • Updated • 164k • 542
• 2
institutional/institutional-books-hl
Preview • Updated • 8.91k
• 308
Viewer • Updated • 34.5k • 63
common-pile/youtube_filtered
Viewer • Updated • 986k • 1.67k
• 7
common-pile/ubuntu_irc_filtered
Viewer • Updated • 216k • 602
• 2
common-pile/pubmed_filtered
Viewer • Updated • 4.77M • 4.03k
• 6
common-pile/github_archive_filtered
Viewer • Updated • 23.3M • 1.17k
• 2
common-pile/biodiversity_heritage_library_filtered
Viewer • Updated • 16.5M • 618
• 2
common-pile/uspto_filtered
Viewer • Updated • 14.4M • 4.84k
• 4
common-pile/usgpo_filtered
Viewer • Updated • 2.34M • 1.8k
• 3
soda-research/emilia-mm-pretrain-fix
Viewer • Updated • 12.6M • 158
fineinstructions/fineinstructions_nemotron
Viewer • Updated • 1.23B • 2.69k
• 28
Viewer • Updated • 1.38M • 702
• 1
Viewer • Updated • 23.5k • 7.98k
• 56
Viewer • Updated • 12.3M • 94.2k
• 107