NVIDIA and AI4Bharat announce 2.8 trillion token Indic pretraining dataset
NVIDIA and AI4Bharat, the Indian language research lab at IIT Madras, announced Nemotron-pretraining-Indic-v1, a corpus of about 2.8 trillion tokens covering the 22 languages listed in India's Constitution. It has native-script data for all 22 languages and romanized text for twelve. The release is due soon, along with the open, GPU-accelerated pipeline that made it, which includes the prompts, LLM workflows and quality checks. The data is translated from curated English sources in Nemotron-CC-v2, and NVIDIA says it complements naturally written Indic text rather than replacing it. NVIDIA says 10 billion Indic tokens drawn from the corpus and natural text raised scores on five Indic benchmarks for Nemotron 3.5 Super VL by 4.98 to 9.82 percentage points. That result covers the whole training stage, not the synthetic data alone.