tvu-vlinhd11/pretrain-dataset-T2048-13B
Pretrain Dataset (Tokenized) This dataset contains tokenized and packed sequences ready for LLM pretraining. Dataset Details Property Value Sequences 6,474,097 Sequence Length 2048 Tokenizer ./vn_spm_v3_fast2/ Total Tokens 13,258,950,332 Shards 13 Created 2025-12-10 Dataset Structure Each sample contains: input_ids: List of token IDs (length: 2048) attention_mask: Attention mask (1 for real tokens, 0 for padding)… See the full description on the dataset page: https://huggingface.co/datasets/tvu-vlinhd11/pretrain-dataset-T2048-13B.
Conversations for this repository live on Hugging Face.
CoolFace shows imported repositories read-only. Posting into someone else’s repository from here would need an authorised integration and the account holder’s consent, so the link goes to the source instead.
Open discussions on Hugging Face