TomatitoToho/nanbeige-dc-trainer
0
Nanbeige-DC Training Space
Fine-tune Nanbeige4.1-3B on Discord bot scenarios using QLoRA for the Zelin DC bot.
Usage
- Enter your HuggingFace write token
- Set target repository (default: TomatitoToho/Nanbeige-DC-v1)
- Adjust training parameters if needed
- Click Start Training
- Wait for training to complete (~15-20 min)
Technical Details
- Base Model: Nanbeige/Nanbeige4.1-3B (3B params, LLaMA-based, Apache 2.0)
- Method: QLoRA (4-bit NF4 quantization + LoRA adapters)
- Training Data: 3000+ Discord bot scenarios (personality, moderation, commands, tech knowledge)
- Format: ChatML (
<|im_start|>user\n...<|im_end|>)
