Nemotron-CC

Nemotron-Pre-Training-Dataset-v1 Release Data Overview This pretraining dataset, for generative AI model training, preserves high-value math and code while enriching it with diverse multilingual Q&A, fueling the next generation of intelligent, globally-capable models. This dataset supports NVIDIA Nemotron Nano 2, a fam

Papers using Nemotron-CC (2)

CCI4.0: A Bilingual Pretraining Dataset for Enhancing Reasoning in Large Language Models2025BeyondWeb: Lessons from Scaling Synthetic Data for Trillion-scale Pretraining2025