Kavyaah/copywriting-llm

🪄 Copywriting LLM

Generate short, high-converting push notifications and ad copies.

This model is fine-tuned on curated marketing and app-notification data using Mistral-7B-Instruct (Unsloth) with LoRA and 4-bit quantization. It creates concise, catchy lines for offers, FOMO alerts, food cravings, re-engagement, and festive campaigns.

Model Details

Property Value Base Model unsloth/mistral-7b-instruct-v0.3 Fine-Tuning LoRA (r = 16, α = 16, dropout = 0.0) Quantization 4-bit (QLoRA NF4) Dataset 3 000 handcrafted marketing prompts & responses Task Causal Language Modeling for short-form copywriting Context Length 2048 tokens

Usage

# from transformers import AutoTokenizer, AutoModelForCausalLM import torch

# Load tokenizer & model tokenizer = AutoTokenizer.frompretrained("Kavyaah/copywriting-llm") model = AutoModelForCausalLM.frompretrained("Kavyaah/copywriting-llm", torch_dtype="auto") model.eval()

# Function to generate push notification def generatecopy(brand, offer, tone="fun", maxnew_tokens=40): prompt = f"""You are an expert marketing copywriter. Write a short, catchy push notification in a {tone} tone. It should promote {brand}'s offer: "{offer}". Keep it under 20 words, engaging, and persuasive."""

inputs = tokenizer(prompt, returntensors="pt") with torch.nograd(): outputs = model.generate( **inputs, maxnewtokens=maxnewtokens, temperature=0.9, topp=0.9, dosample=True ) return tokenizer.decode(outputs[0], skipspecialtokens=True)

Example

print(generate_copy("Zomato", "Flat 60% off on dinner combos this weekend!")) # Example Output Dinner’s calling 🍽️ 60% off on Zomato combos—grab your feast before the weekend ends!

Evaluation

Metric Result

Human rated copy quality 8.5 / 10

Tone accuracy (fun & playful) 93 %

Avg token length 18 words

Intended Use

Generating push notifications, app banners, and micro-ad copies

Creative assistants for marketing and growth teams

Automating A/B test copy variants for offers and sales

Limitations

May produce overly playful or repetitive content if prompts are vague

Trained only for short-form marketing copywriting

Avoid using for sensitive topics or regulated industries

Technical Configuration

Parameter Value

Optimizer AdamW (8-bit)

Learning Rate 2 × 10⁻⁴

Epochs 2

Gradient Accumulation 4

Batch Size (effective) 8

Quantization 4-bit QLoRA

Training Data Categories

Category Example

Sale / Offer “Diwali deals up to 50% off ✨”

Food Craving “Lunch o’clock alert! Your cravings just went live 🍛”

FOMO “Blink and it’s gone 👀 Flash sale ends in 2 hours!”

Re-engagement “We miss your clicks 😢 Come back for something tasty!”

Festive “Play with colors, not your budget! Holi offers just dropped 🎨”

Fashion “New drops just landed 💃 Make your wardrobe jealous!”

License

MIT License - open for research and non-commercial use.

Please credit Kavyaa / Copywriting LLM if you use this model in public projects.

Acknowledgements

Fine-tuned using Unsloth for 2× faster training

Base weights from Mistral-7B-Instruct v0.3

Created by Kavyaa for creative and marketing AI research