Modelpublic

curiousily/falcon-7b-qlora-chat-support-bot-faq

sourceHugging Faceapache-2.0updated 3y agoView on Hugging Face

1likes

Model Card

Falcon 7b model trained on FAQ from an ecommerce website.

Tutorials

—Text tutorial: https://www.mlexpert.io/prompt-engineering/fine-tuning-llm-on-custom-dataset-with-qlora
—YouTube video: https://www.youtube.com/watch?v=DcBC4yGHV4Q

Training

Fine-tuned using the QLoRA technique (only adapter uploaded). With the help of bitsandbytes, peft and transformers. Full reproduction is available in the tutorials.