CoolFace
Modelpublic

darkmaniac7/Qwen3.5-4B-Claude-4.6-Opus-abliterated-MNN

sourceHugging Faceapache-2.0updated 3mo agoView on Hugging Face
0likes64downloads
Model Card

TokForge

  • —Website: https://tokforge.ai
  • —Discord: https://discord.gg/Acv3CBtfVm
  • —Google Play: https://play.google.com/store/apps/details?id=dev.tokforge
  • —iOS TestFlight: https://testflight.apple.com/join/jnufjzRr

Runs on-device in the TokForge app.

Qwen3.5-4B-Claude-4.6-Opus-abliterated (MNN)

Pre-converted Qwen3.5-4B abliterated model in MNN format for on-device inference.

Model Details

  • —Architecture: Qwen3.5 (hybrid LinearAttention + standard attention)
  • —Parameters: 4B (4-bit quantized)
  • —Format: MNN (Alibaba Mobile Neural Network)
  • —Quantization: W4A16 (4-bit weights, 16-bit activations)
  • —Attention: LinearAttention (gateddeltarule) + standard attention hybrid

Performance

DeviceSoCBackendtok/s
S26 UltraSM8850CPU20.5
Lenovo TB520FUSM8650CPU14.0
Xiaomi Pad 7 ProSM8635CPU11.8

CPU is recommended for Qwen3.5 models (LinearAttention runs natively on CPU).

Usage with TokForge

Optimized for TokForge — an Android app for on-device LLM inference.

Abliteration

Safety filters removed for unrestricted conversation. Use responsibly.

Limitations and Intended Use

  • —Intended for TokForge / MNN on-device inference, especially creative writing and roleplay use.
  • —Qwen3.5 hybrid LinearAttention models generally route best to CPU in current TokForge builds.
  • —Performance varies by device class and generation length.
  • —This repo is a packaged runtime artifact, not a standard Transformers training checkpoint.

Community