datasets
Training and evaluation data, with the modality, task and licence stated up front. Listed live from the Hugging Face Hub.
SVAMPqwen-generated-svamp-controls-sft
Qwen-Generated SVAMP CoT Controls ? SFT
Qwen-generated controlled reasoning traces for SVAMP in LLaMA-Factory SFT format. Variants include ordinary, all-caps, no-comma, disclaimer, and multilingual examples.
Splits
3,940 training examples and 380 held-out evaluation examples.
Format
The JSON files use the LLaMA-Factory Alpaca-style schema. The included
dataset_info.json registers the exact training and evaluation names. DPO
records are marked with… See the full description on the dataset page: https://huggingface.co/datasets/akshay-sked/qwen-generated-svamp-controls-sft.X-SVAMP_en_zh_ko_it_es
X-SVAMP
🤗 Paper | 📖 arXiv
Dataset Description
X-SVAMP is an evaluation benchmark for multilingual large language models (LLMs), including questions and answers in 5 languages (English, Chinese, Korean, Italian and Spanish).
It is intended to evaluate the math reasoning abilities of LLMs. The dataset is translated by GPT-4-turbo from the original English-version SVAMP.
In our paper, we evaluate LLMs in a zero-shot generative setting: prompt the instruction-tuned LLM with… See the full description on the dataset page: https://huggingface.co/datasets/zhihz0535/X-SVAMP_en_zh_ko_it_es.qwen-generated-svamp-controls-dpo
Qwen-Generated SVAMP CoT Controls ? DPO
Preference pairs built from Qwen-generated SVAMP reasoning traces in LLaMA-Factory DPO format. Each record contains instruction, input, chosen, and rejected fields.
Splits
3,152 training preference pairs and 304 held-out evaluation pairs.
Format
The JSON files use the LLaMA-Factory Alpaca-style schema. The included
dataset_info.json registers the exact training and evaluation names. DPO
records are marked with… See the full description on the dataset page: https://huggingface.co/datasets/akshay-sked/qwen-generated-svamp-controls-dpo.svamp
svamp — evaluation data (OpenCompass format)
Bud Ecosystem eval mirror. OpenCompass-format evaluation data for svamp, for offline reproducible model evaluation (config svamp_gen). Original source: https://github.com/arkilpatel/SVAMP — license MIT, unchanged; all rights remain with the original authors.