CoolFace
Modelpublic

marianbasti/Llama-2-13b-fp16-alpaca-spanish

sourceHugging Facellama2updated 3y agoView on Hugging Face
1likes25downloads
Model Card

Llama 2-13b-alpaca-spanish LoRA

This is a LoRA for Llama 2 13B trained on a translated alpaca dataset on an attempt to improve spanish performance of the Llama-2 foundation model with a conversational focus.

Base model used was The Bloke's Llama-2-13B-fp16 trained in 4bit precision with an added padding token.

Training parameteres
LoRA scale2
Epochs0.75
Learning Rate2e-5
Warmup Steps100
Loss1.07