CoolFace
Modelpublic

Tivaphraen/Ornith-Agents-A1-GGUF

sourceHugging Faceapache-2.0updated 3mo agoView on Hugging Face
1likes67downloads
Model Card

Background (9)

Ornith-Agents-A1-GGUF

GGUF conversion of tepirale/Ornith-Agents-A1-3.6-35B-A3B-dare_ties for local inference with llama.cpp-compatible runtimes.

About

This model is based on:

Upstream merge sources:

Upstream merge method:

  • —DARE-TIES

This repository provides GGUF files for practical local use.

Important notes

  • —These GGUF files are based on an experimental community merge.
  • —The current release is a text-focused, no-MTP build for compatibility.
  • —If an MTP version is added later, it should be released as a separate variant.

Files

Model files are named like:

  • —Ornith-Agents-A1-Q3_K_M.gguf
  • —Ornith-Agents-A1-Q4_K_M.gguf
  • —Ornith-Agents-A1-Q5_K_M.gguf

Recommended starting point

If you just want to test the model, start with:

  • —Ornith-Agents-A1-Q4_K_M.gguf

Example llama.cpp usage

CLI

bash
./llama-cli \
  -m Ornith-Agents-A1-Q4_K_M.gguf \
  --jinja \
  -c 8192 \
  --temp 0.6 \
  --top-p 0.95 \
  --top-k 20 \
  --min-p 0.0

Server

bash
./llama-server \
  -m Ornith-Agents-A1-Q4_K_M.gguf \
  --jinja \
  -c 8192 \
  --host 127.0.0.1 \
  --port 8080

Credits

Disclaimer

This is a community GGUF conversion of an experimental merge. Please evaluate it yourself for quality, stability, and suitability for your use case.