Datasetpublic

nirmalendu01/abir177m-pretrain-balanced20-ezhijaru

abir177m pretrain mix — balanced20 en/zh/hi/ja/ru Frozen packed-token shards for reproducible abir177m GPT-2–style pretraining. Languages: 20% each en, zh, hi, ja, ru Source streams: FineWeb (en) + FineWeb-2 (zh/hi/ja/ru) Tokenizer: mistralai/Mistral-Nemo-Base-2407 Packing: 2048-token causal LM blocks (input_ids, labels identical) Target budget: 3.55B tokens (1,733k sequences) See meta.json for exact mixture + dataset map + seed.

sourceHugging Faceapache-2.0updated 1mo agoView on Hugging Face

0likes128downloads

50 commits on main

41b0d461mo ago

Upload schema_meta.json with huggingface_hub

nirmalendu01

afa6e751mo ago

add text+language via fineweb replay shard 000431

nirmalendu01

7dd14151mo ago

add text+language via fineweb replay shard 000430

nirmalendu01

e1df3d51mo ago

add text+language via fineweb replay shard 000429

nirmalendu01

f1a144e1mo ago

add text+language via fineweb replay shard 000428

nirmalendu01

d0d50e71mo ago

add text+language via fineweb replay shard 000427

nirmalendu01

90f06991mo ago

add text+language via fineweb replay shard 000426

nirmalendu01

eec43e41mo ago

add text+language via fineweb replay shard 000425

nirmalendu01

e457f721mo ago

add text+language via fineweb replay shard 000424

nirmalendu01

6fa10d71mo ago

add text+language via fineweb replay shard 000423

nirmalendu01

8f8cb091mo ago

add text+language via fineweb replay shard 000422

nirmalendu01

937644d1mo ago

add text+language via fineweb replay shard 000421

nirmalendu01

a0e8d7f1mo ago

add text+language via fineweb replay shard 000420

nirmalendu01

02c47021mo ago

add text+language via fineweb replay shard 000419

nirmalendu01

3d7c7a81mo ago

add text+language via fineweb replay shard 000418

nirmalendu01

f4d23151mo ago

add text+language via fineweb replay shard 000417

nirmalendu01

c86f4021mo ago

add text+language via fineweb replay shard 000416

nirmalendu01

dd9e4181mo ago

add text+language via fineweb replay shard 000415

nirmalendu01

aad26e01mo ago

add text+language via fineweb replay shard 000414

nirmalendu01

26c8d581mo ago

add text+language via fineweb replay shard 000413

nirmalendu01

572fe7b1mo ago

add text+language via fineweb replay shard 000412

nirmalendu01

ac654521mo ago

add text+language via fineweb replay shard 000411

nirmalendu01

f80433d1mo ago

add text+language via fineweb replay shard 000410

nirmalendu01

b6228411mo ago

add text+language via fineweb replay shard 000409

nirmalendu01

4760da31mo ago

add text+language via fineweb replay shard 000408

nirmalendu01

bb3678e1mo ago

add text+language via fineweb replay shard 000407

nirmalendu01

1c958641mo ago

add text+language via fineweb replay shard 000406

nirmalendu01

47b2d821mo ago

add text+language via fineweb replay shard 000405

nirmalendu01

a91e43d1mo ago

add text+language via fineweb replay shard 000404

nirmalendu01

77a8f451mo ago

add text+language via fineweb replay shard 000403

nirmalendu01

84a9a8c1mo ago

add text+language via fineweb replay shard 000402

nirmalendu01

cd58a9d1mo ago

add text+language via fineweb replay shard 000401

nirmalendu01

cb9ae821mo ago

add text+language via fineweb replay shard 000400

nirmalendu01

781bd351mo ago

add text+language via fineweb replay shard 000399

nirmalendu01

7b88a0f1mo ago

add text+language via fineweb replay shard 000398

nirmalendu01

a8cb3d91mo ago

add text+language via fineweb replay shard 000397

nirmalendu01

81a0bd31mo ago

add text+language via fineweb replay shard 000396

nirmalendu01

61fda981mo ago

add text+language via fineweb replay shard 000395

nirmalendu01

f75fe2a1mo ago

add text+language via fineweb replay shard 000362

nirmalendu01

b162ac91mo ago

add text+language via fineweb replay shard 000394

nirmalendu01

6e7210d1mo ago

add text+language via fineweb replay shard 000361

nirmalendu01

99ffd7b1mo ago

add text+language via fineweb replay shard 000393

nirmalendu01

72e0a631mo ago

add text+language via fineweb replay shard 000392

nirmalendu01

35343fb1mo ago

add text+language via fineweb replay shard 000360

nirmalendu01

355cf671mo ago

add text+language via fineweb replay shard 000391

nirmalendu01

7146e421mo ago

add text+language via fineweb replay shard 000359

nirmalendu01

48bd6ef1mo ago

add text+language via fineweb replay shard 000390

nirmalendu01

b1c24861mo ago

add text+language via fineweb replay shard 000358

nirmalendu01

5b1914e1mo ago

add text+language via fineweb replay shard 000389

nirmalendu01

e98ac1f1mo ago

add text+language via fineweb replay shard 000357

nirmalendu01