CoolFace
Modelpublic

meshllm/qwen2.5-0.5b-instruct-parity-q8_0-gguf

sourceHugging Faceapache-2.0updated 6mo agoView on Hugging Face
0likes15downloads
Model Card

Qwen2.5 0.5B Instruct parity GGUF (Q8_0)

This repo contains a same-origin GGUF parity artifact derived from Qwen/Qwen2.5-0.5B-Instruct for backend parity testing with mesh-llm.

Validated exact pair:

  • —GGUF: meshllm/qwen2.5-0.5b-instruct-parity-q8_0-gguf
  • —MLX: meshllm/qwen2.5-0.5b-instruct-parity-8bit-mlx

Exact validation result:

  • —GGUF exact: PASS
  • —MLX exact: PASS
  • —prompt-by-prompt outputs matched on the checked-in exact suite used by mesh-llm

Artifact:

  • —qwen2.5-0.5b-instruct-q8_0.gguf