nirmalendu01/abir177m-pretrain-balanced20-ezhijaru
abir177m pretrain mix — balanced20 en/zh/hi/ja/ru Frozen packed-token shards for reproducible abir177m GPT-2–style pretraining. Languages: 20% each en, zh, hi, ja, ru Source streams: FineWeb (en) + FineWeb-2 (zh/hi/ja/ru) Tokenizer: mistralai/Mistral-Nemo-Base-2407 Packing: 2048-token causal LM blocks (input_ids, labels identical) Target budget: 3.55B tokens (1,733k sequences) See meta.json for exact mixture + dataset map + seed.
Upload schema_meta.json with huggingface_hub
add text+language via fineweb replay shard 000431
add text+language via fineweb replay shard 000430
add text+language via fineweb replay shard 000429
add text+language via fineweb replay shard 000428
add text+language via fineweb replay shard 000427
add text+language via fineweb replay shard 000426
add text+language via fineweb replay shard 000425
add text+language via fineweb replay shard 000424
add text+language via fineweb replay shard 000423
add text+language via fineweb replay shard 000422
add text+language via fineweb replay shard 000421
add text+language via fineweb replay shard 000420
add text+language via fineweb replay shard 000419
add text+language via fineweb replay shard 000418
add text+language via fineweb replay shard 000417
add text+language via fineweb replay shard 000416
add text+language via fineweb replay shard 000415
add text+language via fineweb replay shard 000414
add text+language via fineweb replay shard 000413
add text+language via fineweb replay shard 000412
add text+language via fineweb replay shard 000411
add text+language via fineweb replay shard 000410
add text+language via fineweb replay shard 000409
add text+language via fineweb replay shard 000408
add text+language via fineweb replay shard 000407
add text+language via fineweb replay shard 000406
add text+language via fineweb replay shard 000405
add text+language via fineweb replay shard 000404
add text+language via fineweb replay shard 000403
add text+language via fineweb replay shard 000402
add text+language via fineweb replay shard 000401
add text+language via fineweb replay shard 000400
add text+language via fineweb replay shard 000399
add text+language via fineweb replay shard 000398
add text+language via fineweb replay shard 000397
add text+language via fineweb replay shard 000396
add text+language via fineweb replay shard 000395
add text+language via fineweb replay shard 000362
add text+language via fineweb replay shard 000394
add text+language via fineweb replay shard 000361
add text+language via fineweb replay shard 000393
add text+language via fineweb replay shard 000392
add text+language via fineweb replay shard 000360
add text+language via fineweb replay shard 000391
add text+language via fineweb replay shard 000359
add text+language via fineweb replay shard 000390
add text+language via fineweb replay shard 000358
add text+language via fineweb replay shard 000389
add text+language via fineweb replay shard 000357
