9 results

ModelBest

inall models datasets apps agents people projects

Models

All models matching “ModelBest”

ZhangYuchi /modelbest-Qwen-2.5-Omni-7B-SFT-onlyany-to-anytransformersen2 likes9 downloads3mo agoHugging Face ZhangYuchi /modelbest-Qwen-2.5-Omni-7B-SFT-with-DPOany-to-anytransformersen1 likes5 downloads2mo agoHugging Face iulusoy /model-best0 likes4y agoHugging Face MINATOs /model-bestv20 likes2y agoHugging Face Akki3110 /model-bestgated0 likes2y agoHugging Face witchking999 /Model_Best0 likes10mo agoHugging Face znSkuby /modelbesterai0 likes7mo agoHugging Face renshengjihe /model-best0 likes4mo agoHugging Face

Datasets

All datasets matching “ModelBest”

ZhangYuchi /modelbest-Qwen-2.5-Omni-7B-SFT-with-DPO-dataset_for_DPO OminiGAIA-DPO-data This dataset contains the final DPO training pairs used to train ZhangYuchi/modelbest-Qwen-2.5-Omni-7B-SFT-with-DPO. The pairs are derived from 7B-native rollouts on OmniGAIA train questions: Roll out the SFT model on answer-hidden train inputs. Audit each rollout with Gemini using the private reference answer and annotated solution. Locate the first erroneous assistant sub-step. Convert the corrected prefix (tau_win) and the original erroneous prefix… See the full description on the dataset page: https://huggingface.co/datasets/ZhangYuchi/modelbest-Qwen-2.5-Omni-7B-SFT-with-DPO-dataset_for_DPO.reinforcement-learning1 likes46 downloads2mo agoHugging Face