CoolFace
Modelpublic

nwdxlgzs/XL-LuaCopilot-0.6B-FFT-MNN_Q8

sourceHugging Facegpl-3.0updated 1y agoView on Hugging Face
0likes8downloads
Model Card

XL-LuaCopilot-0.6B-FFT

XL-LuaCopilot-0.6B-FFT is a large language model (LLM) based on the Qwen architecture(Qwen3-0.6B-Base), specifically designed for code generation tasks in Lua programming language. It has been full fine-tuned (FFT) to improve its performance and efficiency when generating Lua code.

I sugggest you use "chat_template_kwargs": {"enable_thinking": false} because my train data with none thinking. I also found low temperature ususually works well for code generation tasks.

How To Use

I'm trying to use MNN (faster than llama.cpp), but the documentation is confusing. I followed the docs to generate the MNN model weights, but their usage is still unknown.

Train Device

Online GPU is Expensive !
类别配置详情
镜像Ubuntu 22.04
PyTorch2.5.1
Python3.12
CUDA12.4
GPURTX 3090 (24GB) * 1
CPU14 vCPU Intel(R) Xeon(R) Platinum 8362 @ 2.80GHz
内存45GB
硬盘30 GB
时长1 Day