Thox-ai/ThoxMicro-1bit-16M
143
ThoxMicro-1bit-16M
Your AI. Your Data. Your Rules.
From-scratch BitNet b1.58 ternary Llama (16M) trained on TinyStories — deeper sibling of the 9M edge research model.
What this is
- Trained from scratch — no upstream base model.
- 86.6% of weights are ternary (BitNet b1.58).
- Same pending-review TinyStories licensing caveat as the 9M.
- Neither the 9M nor 16M supersedes the other.
Architecture (from config)
Intended use
On-device / edge text generation within the THOX stack. Not a safety-aligned public assistant unless deployed behind THOX guardrails.
Usage
llama.cpp
huggingface-cli download Thox-ai/ThoxMicro-1bit-16M --include '*.gguf' --local-dir ./ThoxMicro-1bit-16M
llama-cli -m ./ThoxMicro-1bit-16M/model-TQ2_0.gguf -p "Hello"Links
- Ollama:
ollama.com/thox-ai/<slug>— verify with the Ollama lane (task 80017303) - Docs: https://docs.thox.ai
THOX.ai LLC — Your AI. Your Data. Your Rules. · On-device and private by design.
