CoolFace
Modelpublic

Thox-ai/ThoxMicro-1bit-16M

sourceHugging Faceotherupdated 2mo agoView on Hugging Face
1likes43downloads
Model Card

ThoxMicro-1bit-16M

License Params GGUF Format

Your AI. Your Data. Your Rules.

From-scratch BitNet b1.58 ternary Llama (16M) trained on TinyStories — deeper sibling of the 9M edge research model.

What this is

  • —Trained from scratch — no upstream base model.
  • —86.6% of weights are ternary (BitNet b1.58).
  • —Same pending-review TinyStories licensing caveat as the 9M.
  • —Neither the 9M nor 16M supersedes the other.

Architecture (from config)

FieldValue
ArchitectureBitNet b1.58 ternary Llama decoder
Layers16
Hidden size256
Attention heads8
KV heads8
FFN / intermediate768
Vocab8,192 (own byte-level BPE)
Max context512
Tied embeddingsyes

Intended use

On-device / edge text generation within the THOX stack. Not a safety-aligned public assistant unless deployed behind THOX guardrails.

Usage

llama.cpp

bash
huggingface-cli download Thox-ai/ThoxMicro-1bit-16M --include '*.gguf' --local-dir ./ThoxMicro-1bit-16M
llama-cli -m ./ThoxMicro-1bit-16M/model-TQ2_0.gguf -p "Hello"

Links

  • —Ollama: ollama.com/thox-ai/<slug> — verify with the Ollama lane (task 80017303)
  • —Docs: https://docs.thox.ai

THOX.ai LLC — Your AI. Your Data. Your Rules. · On-device and private by design.