SmolLM3-3B
details_bestdive__SmolLM3-3B-SFT-Free-Course
Smol course SFT evaluation - Kay Zheng
Actual full GSM8K test evaluation of bestdive/SmolLM3-3B-SFT-Free-Course, adapter revision 0484e028b494d605a267050a949c9266edadd16b, merged with pinned SmolLM3-3B-Base before evaluation.
Full 1319 test examples, zero-shot, original extractive_match: 0.4086429112964367 (stderr 0.013540639733342422).
Free Google Colab T4, no paid HF Jobs; cost 0.
lighteval 0.11.0, vLLM 0.10.1.1, Transformers 4.57.1, Python 3.12.
Dataset-address correction… See the full description on the dataset page: https://huggingface.co/datasets/bestdive/details_bestdive__SmolLM3-3B-SFT-Free-Course.tis-subset-datasets-SmolLM3-3B-Basedetails_pmakiela__SmolLM3-3B-dpo-v0_1_private
Dataset Card for Evaluation run of pmakiela/SmolLM3-3B-dpo-v0_1
Dataset automatically created during the evaluation run of model pmakiela/SmolLM3-3B-dpo-v0_1.
The dataset is composed of 4 configuration, each one corresponding to one of the evaluated task.
The dataset has been created from 2 run(s). Each run can be found as a specific split in each configuration, the split being named using the timestamp of the run.The "train" split is always pointing to the latest results.
An… See the full description on the dataset page: https://huggingface.co/datasets/pmakiela/details_pmakiela__SmolLM3-3B-dpo-v0_1_private.tis-dolci-subset-datasets-SmolLM3-3B-Basedetails_FrancescoArno94__SmolLM3-3B-math_private
Dataset Card for Evaluation run of FrancescoArno94/SmolLM3-3B-math
Dataset automatically created during the evaluation run of model FrancescoArno94/SmolLM3-3B-math.
The dataset is composed of 1 configuration, each one corresponding to one of the evaluated task.
The dataset has been created from 1 run(s). Each run can be found as a specific split in each configuration, the split being named using the timestamp of the run.The "train" split is always pointing to the latest results.… See the full description on the dataset page: https://huggingface.co/datasets/FrancescoArno94/details_FrancescoArno94__SmolLM3-3B-math_private.MMLU-Pro_SmolLM3-3B_test
MMLU-Pro_SmolLM3-3B_test