CoolFace
Modelpublic

yijhen38/llama2-TinyPixel-qlora-FT-chinese

sourceHugging Faceupdated 3y agoView on Hugging Face
0likes12downloads
Model Card

參考 Fine Turning https://colab.research.google.com/drive/12dVqXZMIVxGI0uutU6HG9RWbWPXL3vts?usp=sharing#scrollTo=mNnkgBq7Q3EU

Model：AlexanderDoria/novel17_test dataset：COT_Answer.txt

Training procedure

The following bitsandbytes quantization config was used during training:

  • —loadin8bit: False
  • —loadin4bit: True
  • —llmint8threshold: 6.0
  • —llmint8skip_modules: None
  • —llmint8enablefp32cpu_offload: False
  • —llmint8hasfp16weight: False
  • —bnb4bitquant_type: nf4
  • —bnb4bitusedoublequant: False
  • —bnb4bitcompute_dtype: float16

Framework versions

  • —PEFT 0.5.0.dev0