damBruh/skyyrose-brand-voice-llm
07
SkyyRose Brand Voice LLM
Fine-tuned brand voice model for SkyyRose luxury streetwear. Uses LoRA adapters on Qwen/Qwen2.5-0.5B-Instruct.
Model Details
- Base Model: Qwen/Qwen2.5-0.5B-Instruct (494M parameters)
- Method: LoRA (r=16, alpha=32)
- Trainable Params: 2.2M (0.44%)
- Training Data: 20 brand voice examples
- Final Loss: 1.15
Brand Guidelines
- Tone: Sophisticated yet accessible, bold yet elegant
- Style: Poetic, evocative, with street culture authenticity
- Colors: Rose gold (#B76E79), black (#1A1A1A), pastels
- Tagline: "Where Love Meets Luxury"
- Collections: Signature (classic), Black Rose (dark romantic), Love Hurts (edgy)
Usage
from transformers import AutoTokenizer, AutoModelForCausalLM
from peft import PeftModel
# Load base model and LoRA adapter
base_model = AutoModelForCausalLM.from_pretrained("Qwen/Qwen2.5-0.5B-Instruct")
model = PeftModel.from_pretrained(base_model, "damBruh/skyyrose-brand-voice-llm")
tokenizer = AutoTokenizer.from_pretrained("Qwen/Qwen2.5-0.5B-Instruct")
# Generate SkyyRose brand voice content
prompt = """<|im_start|>system
You are SkyyRose's brand voice - a luxury streetwear brand from Oakland, California.
<|im_end|>
<|im_start|>user
Write a product description for a rose gold hoodie.
<|im_end|>
<|im_start|>assistant
"""
inputs = tokenizer(prompt, return_tensors="pt")
outputs = model.generate(**inputs, max_length=300, temperature=0.7)
print(tokenizer.decode(outputs[0], skip_special_tokens=True))Training Details
- Device: CPU (Apple Silicon M1)
- Batch Size: 1
- Gradient Accumulation: 4
- Epochs: 5
- Learning Rate: 3e-4
- Max Sequence Length: 256
- Training Time: ~11 minutes
Examples
Product Description
Prompt: "Write a product description for rose gold joggers."
Output: "Introducing the SkyyRose Signature Joggers - where Oakland street culture meets luxury comfort. Crafted in our iconic rose gold hue, these premium joggers embody effortless sophistication..."
Social Media
Prompt: "Write an Instagram caption for a new collection drop."
Output: "New pieces. Same soul. The latest from SkyyRose - where Oakland authenticity meets global luxury. Limited quantities. Timeless style. 🌹 #WhereloveMeetsLuxury"
License
Apache 2.0
Contact
- Brand: SkyyRose
- Website: https://skyyrose.co
- HuggingFace: https://huggingface.co/damBruh
