Alignment-Lab-AI/axolotl2

Axolotl Axolotl is a tool designed to streamline the fine-tuning of various AI models, offering support for multiple configurations and architectures. Features: Train various Huggingface models such as llama, pythia, falcon, mpt Supports fullfinetune, lora, qlora, relora, and gptq Customize configurations using a simple yaml file or CLI overwrite Load different dataset formats, use custom formats, or bring your own tokenized datasets Integrated with xformer, flash attention… See the full description on the dataset page: https://huggingface.co/datasets/Alignment-Lab-AI/axolotl2.