BrandeisPatrick/Ouro-2.6B-Thinking-GGUF

Ouro-2.6B-Thinking — GGUF

GGUF conversions of ByteDance/Ouro-2.6B-Thinking, the reasoning-tuned member of the Ouro family of looped language models. The 48-layer decoder stack is applied 4 times per token with shared weights, so a 2.7B-parameter model computes at an effective depth of 192 layers.

These are the first GGUFs of this architecture. llama.cpp had no ouro architecture, so no GGUF runtime could load Ouro at all. The architecture was written for this release; the patch, the evaluation harness and the validation data are at BrandeisPatrick/loop-transformer.

Needs a patched llama.cpp today. The ouro architecture is not yet upstream, so stock llama.cpp, Ollama and LM Studio cannot load these files yet. Build with the patch: git clone https://github.com/BrandeisPatrick/loop-transformer && loop-transformer/llamacpp/build.sh Once the upstream PR merges and Ollama bumps its pin, these run unmodified.

Files

What is verified here, and what is not

Being precise, because this variant was not benchmarked end-to-end:

Verified on these files. Loads as arch = ouro, n_layer = 192 (48 physical × 4 loops) at 2.67 B parameters — depth expanded, weights stored once — and generates correct, coherent output (~8.3 tok/s on an Apple M4, Q8_0).

Verified on the same code path, using [Ouro-1.4B](https://huggingface.co/BrandiesPatrick/Ouro-1.4B-GGUF). The port reproduces the transformers reference across loop depths: 26.0 / 67.0 / 80.5 percent on GSM8K at 1 / 2 / 4 loops against 23.0 / 64.0 / 80.0, every point within one standard error, with token-identical greedy output. That is the evidence the architecture is correct.

Not verified here. This model's published numbers (AIME24/25, OlympiadBench, BeyondAIME) are scored with an unreleased LLM-as-judge rubric, so they cannot be reproduced independently and no accuracy figure for this variant is claimed. If you need a benchmarked file, use the 1.4B.

The loop count is a runtime dial

The compute/accuracy trade-off is adjustable at load time from a single file:

llama-cli -m Ouro-2.6B-Thinking-Q8_0.gguf --override-kv ouro.num_loops=int:2   # 96 layers, ~2x faster
llama-cli -m Ouro-2.6B-Thinking-Q8_0.gguf                                      # 192 layers, default

The model was trained at 4 loops; the paper's ablation shows quality peaking at or just below the trained depth and degrading beyond it. On the 1.4B, a single loop collapses accuracy to 26% — always quote the depth alongside any number from these files.

Provenance

Converted from ByteDance/Ouro-2.6B-Thinking with a llama.cpp built from upstream 67672dc plus the ouro architecture patch. The early-exit gate is deliberately not converted: it selects which already-computed loop feeds the LM head rather than changing what is computed, and at the shipped early_exit_threshold = 1.0 it never fires.

Citation

@article{ouro2025,
  title  = {Scaling Latent Reasoning via Looped Language Models},
  author = {ByteDance Seed},
  journal= {arXiv:2510.25741},
  year   = {2025}
}