CoolFace
Modelpublic

lschaffer/qwen2_5_1_5b-git

sourceHugging Faceapache-2.0updated 4mo agoView on Hugging Face
0likes23downloads
Model Card

qwen25-1p5b-git

⚠️ This model is trained for the git MCP server. It is optimised for structured MCP tool-call generation and is not intended to be a general-purpose assistant.

GGUF model fine-tuned for structured MCP tool-calling, ready for local inference via Ollama.

Model Details

PropertyValue
MCP servergit
Base model (training)mlx-community/Qwen2.5-1.5B-Instruct-4bit
Base model (fused export)Qwen/Qwen2.5-1.5B-Instruct
Fine-tune methodQLoRA / LoRA adapter fusion
QuantizationQ5KM (5-bit, recommended)
GGUF fileqwen25-1p5b-git-q5km.gguf
Presetqwen251_5b

Intended Use

Intended for agents or apps that call the git MCP server.

The model was trained on a custom MCP tool-call JSONL dataset derived from the server's tool schema. It is intended to emit structured JSON tool calls for that server and is not suited for general chat.

Quick Start (Ollama)

Option 1: Direct from Ollama registry (if published)

bash
ollama pull qwen25-1p5b-git
ollama run qwen25-1p5b-git

Option 2: Download from HuggingFace

\\\`bash

1. Download the GGUF and Modelfile to the same directory

curl -L -o qwen25-1p5b-git-q5km.gguf https://huggingface.co/lschaffer/qwen2515b-git/resolve/main/qwen25-1p5b-git-q5km.gguf curl -L -o Modelfile https://huggingface.co/lschaffer/qwen2515b-git/resolve/main/Modelfile

2. Register with Ollama (creates local model from GGUF + Modelfile)

ollama create qwen25-1p5b-git -f Modelfile

3. Run the model

ollama run qwen25-1p5b-git \\\`

Important: The \Modelfile\ contains the required TEMPLATE directive for tool support. Registering the GGUF without the Modelfile will result in "does not support tools" errors.

Optional Links

  • —Docs: https://lschaffer.github.io/tealkit
  • —Source: https://github.com/lschaffer/tealkit

Files

  • —qwen25-1p5b-git-q5_k_m.gguf
  • —Modelfile — Ollama model definition with system prompt

Notes

Produced via LoRA fine-tuning on Mac Apple Silicon (MLX), adapter fusion, and llama.cpp GGUF conversion. See the training guide for full pipeline details.