datasets
Training and evaluation data, with the modality, task and licence stated up front. Listed live from the Hugging Face Hub.
smollm-corpus-instruct-2M-cosmopedia-v2-gpt2-v2-streaming
A corpus of high quality fine tuning data meant for fine tuning various HelixLM models
Dataset Composition:
A subset sampled from randomly selected shards from https://huggingface.co/datasets/HuggingFaceTB/smollm-corpus cosmopedia-v2 split ...
Added: A preprocessed column formattedconversation concatenating the prompt, text and special tokens for instruct fine tuning.
Added: A token count column tokencount based on GPT2 tokenizer + the fine tuning special tokens.… See the full description on the dataset page: https://huggingface.co/datasets/david-thrower/smollm-corpus-instruct-2M-cosmopedia-v2-gpt2-v2-streaming.StreamingCoT
Streaming Reasoning Math Train/Eval
This dataset is built for streaming real-time reasoning. It provides math
reasoning examples where a model should reason while the input is being read,
rather than waiting for the complete problem context before starting to think.
The dataset is organized into two Hugging Face configs:
Train: supervised fine-tuning data for learning streaming reasoning traces.
Eval: held-out evaluation data with three benchmark splits.
The training reasoning… See the full description on the dataset page: https://huggingface.co/datasets/JunlongTong/StreamingCoT.