tvu-vlinhd11/pretrain-dataset-T2048-13B

Pretrain Dataset (Tokenized) This dataset contains tokenized and packed sequences ready for LLM pretraining. Dataset Details Property Value Sequences 6,474,097 Sequence Length 2048 Tokenizer ./vn_spm_v3_fast2/ Total Tokens 13,258,950,332 Shards 13 Created 2025-12-10 Dataset Structure Each sample contains: input_ids: List of token IDs (length: 2048) attention_mask: Attention mask (1 for real tokens, 0 for padding)… See the full description on the dataset page: https://huggingface.co/datasets/tvu-vlinhd11/pretrain-dataset-T2048-13B.