Modelpublic

dementor-research/dpo_chatbot_arena_nemotron-nano-30b-a3b_as_phi-4_seed42

sourceHugging Faceupdated 3mo agoView on Hugging Face

0likes2downloads

Model Card

dpochatbotarenanemotron-nano-30b-a3basphi-4seed42

Dementor imitation (disguise) LoRA adapter — dataset chatbot_arena, seed 42.

—Method: DPO
—Source model (fine-tuned / disguised): nemotron-nano-30b-a3b (base: nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B-BF16)
—Target model being imitated: phi-4
—Dataset: chatbot_arena | Seed: 42

Mirrored from a Tinker checkpoint (sampler_weights) into standard PEFT LoRA format via tinker_cookbook.weights.build_lora_adapter. Registry key == repo id == dpo_chatbot_arena_nemotron-nano-30b-a3b_as_phi-4_seed42. Part of the current Dementor imitation adapter set.