kevinqz/Qwen3-0.6B-CoreAI

Canonical: `kevinqz/Qwen3-0.6B-CoreAI` — source of truth.

Qwen3 0.6B (fabric, int8)

Apple Core AI chat model — runs fully on-device on Apple Silicon (iPhone / iPad / Mac, macOS/iOS 27+).

A quantized stateful KV-cache chat .aimodel — an Apple Core AI conversion of Qwen/Qwen3-0.6B, with an embedded tokenizer + chat template. Produced by coreai-fabric and indexed by coreai-catalog.

Model facts

Quantization variants

This repo ships multiple tiers of the same conversion. Greedy fidelity is per-token argmax agreement vs the fp16 reference (see Evaluation) — the numbers below are measured, or pending until you run the parity runner.

int4 is the size-optimized tier; int8 is the high-fidelity tier. Pick by your size/quality budget — the measured numbers above tell you the fidelity cost, so you never guess.

Use it

Install via the catalog, then run it with Apple's Foundation Models runtime:

pip install coreai-catalog && coreai-catalog install qwen3-0.6b-int8

import CoreAILanguageModels
import FoundationModels

// modelURL = the installed macos/ bundle directory for this model
let model = try await CoreAILanguageModel(resourcesAt: modelURL)
let session = LanguageModelSession(model: model)
let reply = try await session.respond(to: "Explain on-device AI in one sentence.")
print(reply)

A complete, buildable example lives at coreai-catalog/examples/llm-chat.

Requirements

• —Deployment: macOS 27.0+ / iOS 27.0+, Xcode 27+. The asset serializes with minimum_os v27, so the on-device Swift runtime requires macOS/iOS 27+.
• —A Mac on macOS 26 can convert and inspect the asset but cannot run it on-device (the Swift runtime needs the 27 SDK).
• —Apple Silicon.

Intended use & limitations

• —Intended use: general on-device chat / text generation. Inherits the base model's capabilities, languages, and biases.
• —Limitations: int8 quantized — the high-fidelity tier, near-lossless vs. fp16. See the Evaluation section for the measured greedy fidelity vs the fp16 reference.

Evaluation (parity)

• —Gate A (structure): passed — the bundle's layout + metadata were validated on real hardware (Apple Silicon); the asset loads and generates.
• —Gate B (numeric accuracy): not_run. Task-accuracy evaluation (e.g. tinyMMLU) is pending upstream: Apple's coreai.llm.eval is a stub in coreai-models 0.1.0 that cannot score a stateful KV-cache asset. Greedy fidelity vs fp32 can be measured on-device via the parity runner. fabric never fakes a parity number.
• —Runtime throughput (tok/s): to be published once measured on the on-device (macOS/iOS 27) Swift runtime via coreai-fabric bench. Not estimated — real numbers or none.

Provenance

Machine-readable, in this repo: `parity-report.json` (gate results) · `reproduce-manifest.json` (exact tool + stack + pinned revision to reproduce this conversion) · `LICENSE` (upstream terms).

License and attribution

Weights © 2024 Alibaba Cloud, licensed apache-2.0 — see the bundled LICENSE. This artifact is a converted + quantized derivative of the base model (the Apache-2.0 §4(b) change notice): weights were converted to Apple Core AI format and quantized to int8. The conversion itself is community work.

Links

• —Base model: Qwen/Qwen3-0.6B
• —Reproduce: recipe `qwen3-0.6b-int8` · runnable example
• —Index: coreai-catalog — the neutral registry that ties upstream ↔ this asset ↔ mirror together
• —HF Collection

The on-device Core AI ecosystem

This conversion is part of a broader open ecosystem for running models on Apple's on-device stack — useful references if you're building here:

• —coreai-fabric — the reproducible recipe → .aimodel pipeline that produced this asset.
• —coreai-catalog — the index of Core AI models across the community, with provenance and integration snippets.
• —apple/coreai-models — Apple's official exporters and runtimes.
• —CoreAI Model Zoo and the wider coreai-community — community conversions across many model families.

Not affiliated with Apple

Community conversion. Not produced, hosted, or endorsed by Apple. Apple and Core AI are trademarks of Apple Inc., used here only to describe the target runtime/format. This is an independent community conversion.