CoolFace
Modelpublic

rshrott/falcon-7b-instruct-ft-descriptions-adapters

sourceHugging Faceupdated 3y agoView on Hugging Face
0likes6downloads
Model Card

Training procedure

The following bitsandbytes quantization config was used during training:

  • —loadin8bit: False
  • —loadin4bit: True
  • —llmint8threshold: 6.0
  • —llmint8skip_modules: None
  • —llmint8enablefp32cpu_offload: False
  • —llmint8hasfp16weight: False
  • —bnb4bitquant_type: nf4
  • —bnb4bitusedoublequant: True
  • —bnb4bitcompute_dtype: bfloat16

The following bitsandbytes quantization config was used during training:

  • —loadin8bit: False
  • —loadin4bit: True
  • —llmint8threshold: 6.0
  • —llmint8skip_modules: None
  • —llmint8enablefp32cpu_offload: False
  • —llmint8hasfp16weight: False
  • —bnb4bitquant_type: nf4
  • —bnb4bitusedoublequant: True
  • —bnb4bitcompute_dtype: bfloat16

The following bitsandbytes quantization config was used during training:

  • —loadin8bit: False
  • —loadin4bit: True
  • —llmint8threshold: 6.0
  • —llmint8skip_modules: None
  • —llmint8enablefp32cpu_offload: False
  • —llmint8hasfp16weight: False
  • —bnb4bitquant_type: nf4
  • —bnb4bitusedoublequant: True
  • —bnb4bitcompute_dtype: bfloat16

The following bitsandbytes quantization config was used during training:

  • —loadin8bit: False
  • —loadin4bit: True
  • —llmint8threshold: 6.0
  • —llmint8skip_modules: None
  • —llmint8enablefp32cpu_offload: False
  • —llmint8hasfp16weight: False
  • —bnb4bitquant_type: nf4
  • —bnb4bitusedoublequant: True
  • —bnb4bitcompute_dtype: bfloat16

The following bitsandbytes quantization config was used during training:

  • —loadin8bit: False
  • —loadin4bit: True
  • —llmint8threshold: 6.0
  • —llmint8skip_modules: None
  • —llmint8enablefp32cpu_offload: False
  • —llmint8hasfp16weight: False
  • —bnb4bitquant_type: nf4
  • —bnb4bitusedoublequant: True
  • —bnb4bitcompute_dtype: bfloat16

The following bitsandbytes quantization config was used during training:

  • —loadin8bit: False
  • —loadin4bit: True
  • —llmint8threshold: 6.0
  • —llmint8skip_modules: None
  • —llmint8enablefp32cpu_offload: False
  • —llmint8hasfp16weight: False
  • —bnb4bitquant_type: nf4
  • —bnb4bitusedoublequant: True
  • —bnb4bitcompute_dtype: bfloat16

Framework versions

  • —PEFT 0.4.0.dev0
  • —PEFT 0.4.0.dev0
  • —PEFT 0.4.0.dev0
  • —PEFT 0.4.0.dev0
  • —PEFT 0.4.0.dev0
  • —PEFT 0.4.0.dev0