Modelpublic

niccolasmunoz/personnn-buddy-9b-GGUF

sourceHugging Facemitupdated 3mo agoView on Hugging Face

1likes39downloads

Model Card

Personnn Buddy 9B GGUF

Buddy is PersonnnOS's local language model. It is tuned for conversational assistance, tool use and desktop workflows in Spanish and English.

This repository contains the Q4_K_M GGUF build for local inference with PersonnnOS, llama.cpp or Ollama.

🐼 Give Buddy a body. This is just the brain. PersonnnOS is the sovereign desktop app where Buddy lives: a native browser, workspace, tools and agent — all on your machine, no cloud account required. It installs and runs this model for you with its bundled llama.cpp runtime. → Download PersonnnOS (free) at [personnn.com](https://personnn.com)

PersonnnOS in action

Buddy runs inside PersonnnOS — a native browser, workspace and agent on your machine.


[image]	[image]
Buddy, local and adaptive — presence, appearance and behavior under your control.	Private AI on your VPS — run Buddy on your own infrastructure; data never touches third parties.
[image]	[image]
Brain — reasons over your project's files, relations and memory.	Personal Life (preview) — your agent lives in a shared city: journals, building, trade.

Model details

Property	Value
Base model	deepreinforce-ai/Ornith-1.0-9B
Architecture	Qwen3.5, 9B parameters
Fine-tuning	LoRA/SFT for PersonnnOS workflows
Training examples	397 curated examples
Quantization	Q4KM
File size	5.24 GiB
Recommended context	12,288 tokens
License	MIT

Download

Download personnn-buddy-9b-v2-Q4_K_M.gguf from this repository. PersonnnOS can install and run it with its bundled llama.cpp runtime, without Ollama or a cloud account.

Verify the file after downloading:

bash

shasum -a 256 personnn-buddy-9b-v2-Q4_K_M.gguf

Expected SHA-256:

text

888bb1b58795277abc2371065f88f6f03e4777d881385720416e328ba14809fa

llama.cpp

bash

llama-server \
  -m personnn-buddy-9b-v2-Q4_K_M.gguf \
  --ctx-size 12288 \
  --flash-attn on \
  --host 127.0.0.1 \
  --port 8080

Ollama

Keep Modelfile and the GGUF in the same directory, then run:

bash

ollama create personnn-buddy:9b-v2 -f Modelfile
ollama run personnn-buddy:9b-v2

The included Modelfile defines the intended Buddy identity, context length and sampling defaults.

Evaluation

Buddy v2 scored 11/12 (92%) in PersonnnOS's internal workflow evaluation, with an average first-token latency of 6.9 seconds on the test machine. The suite covers chat, structured tool selection and desktop tasks. These results are internal product measurements, not a general-purpose benchmark.

Intended use

—Local conversational assistance.
—PersonnnOS tools and desktop workflows.
—Spanish-first personal productivity.
—Private on-device inference when run through a local runtime.

The model does not itself enforce permissions. PersonnnOS places tool calls behind its permission broker and requires confirmation for consequential actions.

Limitations

—The model can hallucinate or select an incorrect tool.
—Tool availability and schemas are supplied by the host application.
—Outputs are not professional legal, medical or financial advice.
—External, destructive or irreversible actions should require explicit user confirmation.
—Local privacy depends on the runtime and application configuration. Using a cloud-hosted runtime sends prompts to that service.

Provenance

Personnn Buddy 9B is derived from Ornith-1.0-9B, published by deepreinforce-ai under the MIT license. See THIRD_PARTY_NOTICES.md.

About PersonnnOS

PersonnnOS is a privacy-first personal agent and browser. Learn more at personnn.com.