CoolFace
Modelpublic

meshllm/olmo2-7b-instruct-parity-q8_0-gguf

sourceHugging Faceapache-2.0updated 6mo agoView on Hugging Face
0likes14downloads
Model Card

OLMo-2-1124-7B-Instruct parity Q8_0 GGUF

This repository contains a same-origin GGUF export of allenai/OLMo-2-1124-7B-Instruct prepared for local parity testing in mesh-llm.

Artifact:

  • —olmo2-7b-instruct-q8_0.gguf

Notes:

  • —converted locally from the cached origin checkpoint
  • —quantized to Q8_0
  • —intended to pair with meshllm/olmo2-7b-instruct-parity-8bit-mlx
  • —exact validation passed locally on 2026-04-07

Source model:

  • —https://huggingface.co/allenai/OLMo-2-1124-7B-Instruct