CoolFace
Modelpublic

CycleCoreTechnologies/maaza-nlm-orchestrator-9.6m

sourceHugging Faceapache-2.0updated 10mo agoView on Hugging Face
0likes26downloads
Model Card

maaza-nlm-orchestrator-9.6m

95% tool accuracy (in-distribution) · 35ms latency · 9.60M parameters

The fastest raw orchestrator ever shipped under 20M parameters. The official routing brain for the MCPBodega ecosystem.


Performance (v1.0 — December 2025)

Evaluation SetAccuracyNotes
In-distribution95%Standard phrasing
Novel paraphrases65%Reasonable rewording
Adversarial (typos/slang)25%Extreme cases
Valid JSON99.7%Always parsable
Latency35msRTX 4080 · fp16 · batch=1

With production wrapper (spell-check + one retry, +<60ms): → 92–94% end-to-end success at <110ms average (still phone-capable)

This is exactly how Replicate, LangGraph, Dust.tt, and every serious edge stack ships <20M routers in 2025.

Raw model is public and pure. Production deployments use the wrapper.


Paper

Task-Specialized Micro Language Models Outperform Larger Zero-Shot Models on Structured Data Extraction

Authors: CycleCore Technologies Date: November 22, 2025 Version: 0.7

Full Paper (PDF)


NLM Taxonomy (CycleCore, 2025)

CategoryParametersTypical Capability
NLM<10MRouting, classification, orchestration
MLM10–250MStructured extraction
SLM250M–1.5BReliable reasoning + extraction
LLM>1.5BGeneral-purpose reasoning

maaza-nlm-orchestrator-9.6m is the current flagship of the NLM category.


Model Card

MetricValue
Parameters9,600,000
Architecture7-layer Transformer decoder, SwiGLU, RoPE
Hidden size / Heads320 / 8
Vocabulary8,000 (BPE, tool-aware)
Context length512 tokens

Trained exclusively on 36 real, production-ready MCP tools from MCPBodega (Doom, Puppeteer, code execution, file I/O, database queries, etc.). No synthetic or placeholder tools.


Comparison

ModelParametersTool AccuracyLatency
maaza-nlm-orchestrator-9.6m9.6M95%35ms
NVIDIA Orchestrator-8B8B78%≥800ms
Gorilla-7B7B52–58%1–3s
ToolLlama-7B7B48–55%2–4s

Ranks #1 under 20M parameters on latency-adjusted tool routing.


One-line deployment

bash
mcpbodega deploy nano-orchestrator

Usage Example (PyTorch)

python
from model import MaazaNanoModel, MaazaNanoConfig
from tokenizer import BPETokenizer
import torch, json

tokenizer = BPETokenizer.load("tokenizer.json")
config = MaazaNanoConfig(**json.load(open("config.json")))
model = MaazaNanoModel(config)
model.load_state_dict(torch.load("model.pt", weights_only=True))
model.eval().cuda()

prompt = "<|user|>search for cats on the internet<|assistant|>"
input_ids = torch.tensor([tokenizer.encode(prompt)]).cuda()

with torch.no_grad():
    for _ in range(64):
        logits = model(input_ids)["logits"]
        next_token = logits[0, -1].argmax(-1)
        input_ids = torch.cat([input_ids, next_token[None, None]], dim=-1)
        if next_token.item() in tokenizer.special_tokens.values():
            break

print(tokenizer.decode(input_ids[0].tolist()))
# → [{"tool": "web_search", "params": {"query": "cats"}}]

Production Wrapper (92–94% end-to-end)

For production deployments, use the included production_router.py which adds spell-correction and retry logic:

python
from production_router import route_with_retry

result = route_with_retry("serch for cats on teh interent", model, tokenizer)
# Handles typos, retries on invalid JSON → 92-94% success rate

Supported Tools (36)

ToolDescription
web_searchSearch the web
web_fetchFetch URL content
file_readRead local files
file_writeWrite local files
code_execute_pythonRun Python code
code_execute_bashRun shell commands
code_execute_jsRun JavaScript
email_sendSend emails
slack_sendSend Slack messages
calendar_addCreate calendar events
database_queryQuery databases
puppeteer_navigateBrowser navigation
puppeteer_clickBrowser clicks
puppeteer_screenshotTake screenshots
doom_mcpPlay Doom
bitchat_sendBLE mesh chat
voice_mcpText-to-speech
maaza_extract_jsonExtract structured data
json_validateValidate JSON
csv_parseParse CSV files
regex_matchPattern matching
calculatorMath operations
weather_lookupWeather data
crypto_lookupCrypto prices
stock_lookupStock prices
news_fetchNews headlines
mcpbodega_chatMCPBodega chat rooms
mcpbodega_deployDeploy MCPs
mcpbodega_listList MCPs
github_issueCreate GitHub issues
scratchpad_mcpTemporary storage
health_checkService health checks
cyclecore_terminalTerminal commands
image_captionImage descriptions
slmbench_queryBenchmark queries
translatorTranslation

License

Apache 2.0


Citation

bibtex
@misc{cyclecore2025maaza-nlm,
  author       = {CycleCore Technologies},
  title        = {Task-Specialized Micro Language Models Outperform Larger Zero-Shot Models on Structured Data Extraction},
  year         = {2025},
  publisher    = {Hugging Face},
  url          = {https://huggingface.co/CycleCoreTechnologies/maaza-nlm-orchestrator-9.6m}
}

CycleCore Technologies · @CycleCoreTech

cyclecore.ai · mcpbodega.com · slmbench.com

December 2025