validation_2
olmo-2-pretrain-validationsae-skeskinen-TinyStories-hf-validation-tokenizer-gpt2_playVQAv2_validation
Dataset Card for "VQAv2_validation"
More Information needed
VQAv2_sample_validation
Dataset Card for "VQAv2_sample_validation"
More Information needed
prolong-smollm2-validation
ProLong SmolLM2 validation
Two validation sets for evaluating DCLM-trained language models, retokenized from the code, books, and textbooks subsets of princeton-nlp/prolong-data-64K.
Folder
Context length
Sequences
Usable tokens
Stored tokens
Trailing EOS filler (unused)
4k/
4,096
24,414
99,999,744
100,000,000
256
32k/
32,768
3,051
99,975,168
100,000,000
24,832
Each folder contains prolong_val_100m.bin, per-sequence source metadata in prolong_val_100m.json, and… See the full description on the dataset page: https://huggingface.co/datasets/sycmucmu/prolong-smollm2-validation.Korea-AIHub-middlesenior-dialect-speech-validation-part2