Modelpublic

samandar1105/text-generation

sourceHugging Faceapache-2.0updated 3mo agoView on Hugging Face

0likes

Model Card

text-generation

Fine-tuned version of Qwen/Qwen2.5-0.5B-Instruct on the Databricks Dolly-15k instruction dataset using LoRA (PEFT) + TRL's SFTTrainer.

How to use

python

from transformers import pipeline
gen = pipeline("text-generation", model="samandar1105/text-generation")
result = gen([{"role": "user", "content": "Write a short poem about the ocean."}], max_new_tokens=200)
print(result[0]["generated_text"][-1]["content"])

Training details

—Base model: Qwen/Qwen2.5-0.5B-Instruct
—Method: LoRA (r=16, alpha=32) via PEFT + TRL SFTTrainer
—Epochs: 3
—Learning rate: 2e-4