CoolFace
Modelpublic

spiralMon/Twin-LLM-Fine-Tuned-DPO-Model-Llama-3.1-8B

sourceHugging Faceapache-2.0updated 2mo agoView on Hugging Face
0likes120downloads
Model Card

Uploaded finetuned model

  • —Developed by: spiralMon
  • —License: apache-2.0
  • —Finetuned from model : spiralMon/Twin-LLM-Fine-Tuned-Instruct-Model-Llama-3.1-8B-bnb-4bit

This llama model was trained 2x faster with Unsloth and Huggingface's TRL library.

<img src="https://raw.githubusercontent.com/unslothai/unsloth/main/images/unsloth%20made%20with%20love.png" width="200"/>