Alignment-Lab-AI/axolotl2
Axolotl Axolotl is a tool designed to streamline the fine-tuning of various AI models, offering support for multiple configurations and architectures. Features: Train various Huggingface models such as llama, pythia, falcon, mpt Supports fullfinetune, lora, qlora, relora, and gptq Customize configurations using a simple yaml file or CLI overwrite Load different dataset formats, use custom formats, or bring your own tokenized datasets Integrated with xformer, flash attention… See the full description on the dataset page: https://huggingface.co/datasets/Alignment-Lab-AI/axolotl2.
Conversations for this repository live on Hugging Face.
CoolFace shows imported repositories read-only. Posting into someone else’s repository from here would need an authorised integration and the account holder’s consent, so the link goes to the source instead.
Open discussions on Hugging Face