xxxn3m3s1sxxx/TriLM-3.9B-ATLAS

TriLM-3.9B-ATLAS

This repository contains a highly optimized TQ1 quantized version of the official SpectraSuite/TriLM_3.9B_Unpacked model for the ATLAS Engine ecosystem, designed for native, ultra-low-latency CPU inference without any GPU requirement.

Packed using the unified pack_to_atlas.py toolchain (v2.10.0) with BF16 weight scale correction.

Engine Specifications

Architecture

Verification

During pre-release evaluation, this quantized derivative demonstrated correct convergence:

• —T=0 (argmax): "The capital of France is Paris." — correct deterministic output
• —T=0.7 (sampling): Coherent structured generation with sensible continuation

Note on scale mathematics: the legacy dequantization path divides by the scale factor rather than multiplying. Since this is a constant across all logits for any given output row, the relative probability distribution remains identical under softmax normalization — no effect on output quality.

Prompt Template

This is a base model — no chat template. Use raw text continuation:

The capital of France is

Usage

Python

git clone https://github.com/xxxn3m3s1sxxx/ATLAS-TQ1_0.git

from atlas_infer import AtlasModel

model = AtlasModel("TriLM-3.9B-ATLAS.tq1.atlas")
output = model.generate_c(
    "The capital of France is",
    max_new_tokens=50,
    temperature=0.7,
    top_k=40,
)
print(output)

C++ CLI (standalone, no Python required)

atlas --model TriLM-3.9B-ATLAS.tq1.atlas --prompt "The capital of France is" --max-tokens 50

SSE Web Server

python atlas_server.py --model TriLM-3.9B-ATLAS.tq1.atlas --port 8080
curl http://localhost:8080/v1/chat/completions \
  -H "Content-Type: application/json" \
  -d '{"prompt": "The capital of France is", "max_tokens": 50}'

What is ATLAS?

ATLAS is a CPU inference engine for BitNet b1.58 ternary-quantized models. It repacks HuggingFace safetensors into the TQ1.0 format (5 ternary trits per byte, Base-3 encoding, ~1.58 bits/weight) and runs fast inference via a C++ DLL + Python wrapper.

Links

• —Engine source code: github.com/xxxn3m3s1sxxx/ATLAS-TQ1_0

License