Modelpublic

Kdffff/midjourney-falcon-7b

sourceHugging Faceupdated 2y agoView on Hugging Face

0likes3downloads

Model Card

My Model

This model is designed for text generation using LoRA.

Training procedure

The following bitsandbytes quantization config was used during training:

—loadin8bit: False
—loadin4bit: True
—llmint8threshold: 6.0
—llmint8skip_modules: None
—llmint8enablefp32cpu_offload: False
—llmint8hasfp16weight: False
—bnb4bitquant_type: nf4
—bnb4bitusedoublequant: True
—bnb4bitcompute_dtype: bfloat16

Framework versions

—PEFT 0.4.0