OsaurusAI/Muse-Glimmer-30B-JANG_2D

<p align="center"><a href="https://osaurus.ai"><img src="./osaurus-x-banner.png" alt="Osaurus AI"></a></p>

Muse-Glimmer-30B-JANG_2D

JANG mixed-affine quantization of `meta-models/Muse-Glimmer-30B` for Apple Silicon runtimes that implement Muse Glimmer's dense multimodal architecture.

Bundle

This is a post-training quantization baseline. The upstream BF16 checkpoint contains no QAT weights or QAT scale metadata. GPTQ, imatrix, and AWQ were not applied, and the metadata says so explicitly.

Native model contract

• —Text input and text output are part of the source architecture.
• —The vision tower, adapter, projection, image processor, and video processor sidecars are preserved. Image/video execution in vMLX remains unverified.
• —Reasoning uses reasoning_strength=low|medium|high|xhigh; omission defaults to high in the shipped chat template.
• —Reasoning output is an assistant to=self channel. Visible content is addressed to=user.
• —Tools use the ATEM function-call grammar. A Muse-specific incremental reasoning parser and ATEM tool parser are required.
• —Deployment sampling follows the upstream model-card recommendation: do_sample=true, temperature=1.0, top_p=0.95, and top_k=64. BOS is 200000, EOS is [200001, 200008], pad is 200018, and maximum length is 131072.
• —Cache topology is heterogeneous: rotating KV with window 2048 on 39 layers and unbounded KV on full-attention layers 3, 7, ..., 51.

Runtime status

PARTIAL / text generation verified in the target runtime. On 2026-08-10, the exact local JANG2D bundle was loaded by Osaurus/vmlx-swift with all 418 per-module mixed-bit overrides. A request with no sampling or reasoning override, `Reply with exactly: FOUR`, returned visible content `FOUR`, a separate non-empty `reasoningcontent, and finish_reason=stop` at 36.87 tokens/s. This covers coherent text generation, the native default reasoning path, reasoning-channel separation, and EOS handling.

Still unverified: grounded image input, grounded video input, ATEM tool round trips, multi-turn behavior, and prefix/partial-block/suffix cache reuse.

Do not interpret repository availability or structural loading as production readiness. This format is not a uniform mlx_lm quant; loaders must honor every per-module entry in config.json.quantization.

Files

• —config.json: Muse architecture plus per-module affine overrides.
• —jang_config.json: source revision, profile, capability, reasoning/tool, modality, generation, and mixed full/sliding cache metadata.
• —chat_template.jinja: exact upstream Muse channel/ATEM template.
• —processor_config.json: exact upstream image/video processor contract.
• —generation_config.json: upstream-recommended deployment sampling plus the source token IDs and maximum length.
• —LICENSE and USAGE_POLICY.md: copied from the pinned upstream source.

Download

hf download OsaurusAI/Muse-Glimmer-30B-JANG_2D \
  --local-dir ~/models/OsaurusAI/Muse-Glimmer-30B-JANG_2D

Verification

From the JANG repository:

PYTHONPATH=jang-tools uv run --no-project \
  --with mlx --with numpy --with safetensors --with tqdm \
  python jang-tools/scripts/verify_muse_glimmer_artifact.py \
  ~/models/OsaurusAI/Muse-Glimmer-30B-JANG_2D \
  --profile JANG_2D --dequant

Korean summary

이 번들은 공식 meta-models/Muse-Glimmer-30B BF16 체크포인트를 Apple Silicon용 JANG 혼합 affine 형식으로 변환한 JANG_2D PTQ 모델입니다. 52개 언어 레이어는 슬라이딩/전체 어텐션 구조를 유지하며, 비전 타워·어댑터·프로젝션 809개 텐서는 FP16으로 보존됩니다. 기본 추론 강도는 high이고 도구 호출은 ATEM 형식입니다. 현재 파일 구조, 메타데이터, 사이드카 및 일부 역양자화 비교를 확인했습니다. 실제 Osaurus/vmlx-swift에서 기본 추론 경로의 일관된 텍스트 생성, 분리된 reasoning_content 및 EOS 종료를 확인했습니다. 이미지/비디오, ATEM 도구 왕복, 멀티턴 및 캐시 재사용은 아직 검증되지 않았습니다. 별도 5레이어 DFlash assistant는 포함하지 않습니다.

License and use

Apache 2.0 license and the upstream Muse Glimmer Usage Policy apply. Review LICENSE and USAGE_POLICY.md before use.

Contact

eric@osaurus.ai