Infernaught/codealpaca_jz
05
1---2library_name: peft3---4## Training procedure5 6 7The following `bitsandbytes` quantization config was used during training:8- load_in_8bit: False9- load_in_4bit: True10- llm_int8_threshold: 6.011- llm_int8_skip_modules: None12- llm_int8_enable_fp32_cpu_offload: False13- llm_int8_has_fp16_weight: False14- bnb_4bit_quant_type: nf415- bnb_4bit_use_double_quant: True16- bnb_4bit_compute_dtype: float1617 18The following `bitsandbytes` quantization config was used during training:19- load_in_8bit: False20- load_in_4bit: True21- llm_int8_threshold: 6.022- llm_int8_skip_modules: None23- llm_int8_enable_fp32_cpu_offload: False24- llm_int8_has_fp16_weight: False25- bnb_4bit_quant_type: nf426- bnb_4bit_use_double_quant: True27- bnb_4bit_compute_dtype: float1628### Framework versions29 30- PEFT 0.4.031 32- PEFT 0.4.033 