Honkware/Qwen3.8-27B-EfficientThink-Uncensored-K3-Opus5-Grok4.6-GPT5.6Sol-SFT-SimPO-DFlash2-exl3-4.0bpw
<div align="center">
Qwen3.8 · 27B · EfficientThink · Uncensored · K3 · Opus5 · Grok4.6 · GPT5.6Sol · SFT · SimPO · DFlash2
<sub><code>EXL3</code> · <b>4.0 bpw</b> · 16.3 GB · Dense</sub>
<br/>
   
  
</div>
[!NOTE] An ExLlamaV3 build of `nerkyor/Qwen3.8-27B-EfficientThink-Uncensored-K3-Opus5-Grok4.6-GPT5.6Sol-SFT-SimPO-DFlash2` at 4.0 bits per weight. See Quants for sibling repos at other bit‑widths or browse the collection.
Quants
<div align="center">
</div>
Inference
<table> <thead> <tr> <th align="left" width="32%">Loader</th> <th align="left">Use it for</th> </tr> </thead> <tbody> <tr> <td><a href="https://github.com/theroyallab/tabbyAPI"><b>TabbyAPI</b></a></td> <td>OpenAI‑compatible HTTP server. Drop‑in for OpenAI clients.</td> </tr> <tr> <td><a href="https://github.com/oobabooga/text-generation-webui"><b>text‑generation‑webui</b></a></td> <td>Local chat UI. Pick the <i>ExLlamaV3</i> loader from the model dropdown.</td> </tr> <tr> <td><a href="https://github.com/turboderp-org/exllamav3"><b>ExLlamaV3</b></a></td> <td>Direct Python API for embedding the model in your own code or pipeline.</td> </tr> </tbody> </table>
Download
pip install -U huggingface_hub
hf download \
Honkware/Qwen3.8-27B-EfficientThink-Uncensored-K3-Opus5-Grok4.6-GPT5.6Sol-SFT-SimPO-DFlash2-exl3-4.0bpw \
--local-dir ./Qwen3.8-27B-EfficientThink-Uncensored-K3-Opus5-Grok4.6-GPT5.6Sol-SFT-SimPO-DFlash2-exl3-4.0bpw<details> <summary><b>Quantization recipe</b> <sub>(advanced, embedded in <code>quantization_config.json</code>)</sub></summary>
<br/>
</details>
License & use
[!IMPORTANT] Use and license follow the [base model](https://huggingface.co/nerkyor/Qwen3.8-27B-EfficientThink-Uncensored-K3-Opus5-Grok4.6-GPT5.6Sol-SFT-SimPO-DFlash2). Quantization adds no additional restrictions. Refer to the upstream repository for terms, citation, and safety documentation.
<div align="center"> <sub><i>Quantized with <a href="https://github.com/Honkware/blockquant"><b>BlockQuant</b></a> · convention <code>{org}/{model}-exl3-{bpw}bpw</code></i></sub> </div>
