Datasetpublic

nirmalendu01/abir177m-pretrain-balanced20-ezhijaru

abir177m pretrain mix — balanced20 en/zh/hi/ja/ru Frozen packed-token shards for reproducible abir177m GPT-2–style pretraining. Languages: 20% each en, zh, hi, ja, ru Source streams: FineWeb (en) + FineWeb-2 (zh/hi/ja/ru) Tokenizer: mistralai/Mistral-Nemo-Base-2407 Packing: 2048-token causal LM blocks (input_ids, labels identical) Target budget: 3.55B tokens (1,733k sequences) See meta.json for exact mixture + dataset map + seed.

sourceHugging Faceapache-2.0updated 1mo agoView on Hugging Face

0likes128downloads

settings

This repository belongs to nirmalendu01 on Hugging Face.

CoolFace never edits a repository it does not host. Visibility, licence, collaborators and gating are all managed at the source.

nameabir177m-pretrain-balanced20-ezhijaru

visibilitypublic

licenceapache-2.0

gatedno

ownernirmalendu01

Account settings