Shekswess/tiny-think-sft-math-stem-loss-dft-bf16-lr5e-5-e2-bs8

Model Card for tiny-think-sft-math-stem-loss-dft-bf16-lr5e-5-e2-bs8

This model is a fine-tuned version of facebook/MobileLLM-R1-140M-base. It has been trained using TRL.

Training procedure

This model was trained with SFT.

Framework versions

• —TRL: 0.26.2
• —Transformers: 4.57.3
• —Pytorch: 2.9.0+cu128
• —Datasets: 4.4.2
• —Tokenizers: 0.22.2