AIHugging Face1h ago
Scaling Indic Pretraining: 2.8 Trillion Tokens and an Open Data
Scaling Indic Pretraining: 2.8 Trillion Tokens and an Open Data Generation Pipeline
TL;DRResearchers created massive Indian language AI training dataset with open pipeline.
Why it matters: Closes AI capability gap for underrepresented languages; enables competitive local models.
Source: Hugging Face · Opens in new tab