CoolFace
Modelpublic

Irfanuruchi/Qwen3-4B-Computer-Science-MLX-4bit

sourceHugging Faceapache-2.0updated 2mo agoView on Hugging Face
0likes23downloads
Model Card

Qwen3-4B-Computer-Science-MLX-4bit

Overview

Qwen3-4B-Computer-Science-MLX-4bit is a 4-bit MLX conversion of Qwen3-4B-Computer-Science for inference on Apple Silicon.

The model was converted from the original BF16 Safetensors release using mlx-lm. It is intended for local inference on supported Mac systems using the MLX framework.


Model Information

PropertyValue
Source modelIrfanuruchi/Qwen3-4B-Computer-Science
Base architectureQwen3-4B
FrameworkMLX
Quantization4-bit
Quantization group size64
Effective bits per weight4.501
Weight formatSafetensors
Primary platformApple Silicon
LanguageEnglish
LicenseApache-2.0

Training Data

The source model was instruction-tuned using permissively licensed datasets.

DatasetConfigurationLicense
HuggingFaceTB/smoltalksmol-magpie-ultraApache-2.0
agentica-org/DeepCoder-Preview-DatasetprimeintellectMIT

Dataset Size

SplitSamples
Training60,989
Evaluation512

Intended Use

This model is intended for:

  • Software engineering
  • Programming assistance
  • Code generation
  • Debugging
  • Code review
  • Algorithm implementation
  • Computer science education
  • General technical reasoning

Installation

Install MLX-LM:

bash
python -m pip install mlx-lm

Usage

Command Line

bash
mlx_lm.generate \
  --model Irfanuruchi/Qwen3-4B-Computer-Science-MLX-4bit \
  --prompt "Write a Python function that returns the first n Fibonacci numbers." \
  --max-tokens 200

Python

python
from mlx_lm import generate, load

model, tokenizer = load(
    "Irfanuruchi/Qwen3-4B-Computer-Science-MLX-4bit"
)

response = generate(
    model,
    tokenizer,
    prompt="Write a Python function that returns the first n Fibonacci numbers.",
    max_tokens=200,
)

print(response)

Conversion

The model was converted from:

text
Irfanuruchi/Qwen3-4B-Computer-Science

Conversion configuration:

ParameterValue
Quantization enabledYes
Quantization bits4
Quantization group size64
Effective bits per weight4.501

Release Validation

The release was validated locally on Apple Silicon.

TestResult
MLX conversionPassed
Model loadingPassed
Text generationPassed
Generation speed53.512 tokens/sec
Peak memory2.356 GB

Performance measurements are from one local generation test and may vary by device, prompt, context length, and software version.


Release Artifacts

text
model.safetensors
model.safetensors.index.json
config.json
generation_config.json
tokenizer.json
tokenizer_config.json
added_tokens.json
special_tokens_map.json
merges.txt
vocab.json
README.conversion.md
SHA256SUMS
LICENSE
README.md

Integrity Verification

Verify the downloaded files on macOS:

bash
shasum -a 256 -c SHA256SUMS

On Linux:

bash
sha256sum -c SHA256SUMS

Limitations

  • Quantization can affect output quality relative to the BF16 checkpoint.
  • The model may produce incorrect or incomplete code.
  • Generated code should be reviewed and tested before use.
  • Performance depends on the Apple Silicon device and available memory.
  • This release is intended for MLX-compatible systems.

License

The model is distributed under the Apache License 2.0.

The source model is based on Qwen3-4B, which is also distributed under the Apache License 2.0.


Acknowledgements

  • Alibaba Qwen Team
  • Apple MLX Team
  • Hugging Face
  • SmolTalk contributors
  • DeepCoder contributors

Citation

bibtex
@software{uruci2026qwen3computersciencemlx,
  title={Qwen3-4B-Computer-Science-MLX-4bit},
  author={Irfan Uruçi},
  year={2026},
  publisher={Hugging Face}
}