hotdogs/Agents-A1-4B-Fable-Preview-heretic-GGUF

<h1 align="center">🤖 Agents-A1-4B-Fable-Preview-heretic-GGUF (uncensored)</h1>

<p align="center"> <b>GGUF Quantized — 4B Vision-Language Agent Model · Fable Reasoning · Tool-Calling · Unchained 🔓</b> </p>

<p align="center"> <img src="https://img.shields.io/badge/license-AGPL--3.0-red"> <img src="https://img.shields.io/badge/Base-hotdogs/Agents--A1--4B--Fable--Preview--heretic-blue"> <img src="https://img.shields.io/badge/GGUF-Q4KM-brightgreen"> <img src="https://img.shields.io/badge/Vision-✅-brightgreen"> <img src="https://img.shields.io/badge/Uncensored-🔓-red"> <img src="https://img.shields.io/badge/Fable-Reasoning-orange"> </p>

<br>

GGUF quantized version of hotdogs/Agents-A1-4B-Fable-Preview-heretic — abliterated with heretic for unrestricted responses. Optimized for llama.cpp inference with vision support.

🔓 Uncensored

This GGUF is the quantized version of the heretic-abliterated model. Refusal mechanisms were reduced to ~11% using heretic while preserving reasoning and tool-calling quality.

✨ Key Features

📦 Downloads

🎯 IQ4_NL is recommended for 8GB VRAM users — fits comfortably even at 128K context with flash-attention.

🚀 Usage

Docker (Recommended)

sudo docker run --rm -p 8080:8080 \
  -v /root/models/:/models \
  --gpus all \
  --ulimit memlock=-1:-1 \
  --env CUDA_VISIBLE_DEVICES=0 \
  ghcr.io/ggml-org/llama.cpp:full-cuda --server \
  -m /models/Agents-A1-4B-Fable-Preview-heretic-IQ4_NL.gguf \
  --mmproj /models/Agents-A1-4B-mmproj.gguf \
  --host 0.0.0.0 --port 8080 \
  --n-gpu-layers 999 \
  --ctx-size 131072 \
  --batch-size 4096 \
  --ubatch-size 256 \
  --cache-type-k f16 \
  --cache-type-v f16 \
  --flash-attn on \
  --cont-batching \
  --mlock \
  --temp 0.95 \
  --top-k 40 \
  --top-p 0.9 \
  --min-p 0.0 \
  -n -1 \
  --no-mmap \
  --parallel 1 --tools all \
  --dry-multiplier 0.05 \
  --jinja --dry-sequence-breaker none \
  --repeat-penalty 1.1

llama.cpp (Direct)

# Quick text-only test
./llama-cli -m Agents-A1-4B-Fable-Preview-heretic-IQ4_NL.gguf \
  -p "Hello" -n 100 --temp 0.6 -ngl 999

# Vision inference
./llama-cli -m Agents-A1-4B-Fable-Preview-heretic-IQ4_NL.gguf \
  --mmproj Agents-A1-4B-mmproj.gguf \
  --image photo.jpg \
  -p "What is in this image?" -n 256 --temp 0.6 -ngl 999

🧬 Model Information

This is a GGUF quantized version of hotdogs/Agents-A1-4B-Fable-Preview-heretic, which is an abliterated fine-tune of InternScience/Agents-A1-4B.

⚠️ Disclaimer

This model is uncensored and may generate content that is offensive, harmful, or inappropriate. Use at your own risk. The authors are not responsible for any misuse.

🙏 Acknowledgements / ขอบคุณ

• —[InternScience](https://huggingface.co/InternScience) — For the Agents-A1-4B base model and mmproj vision projector 🙏
• —mmproj source — Extracted from InternScience/Agents-A1-4B-Q4_K_M-GGUF
• —[p-e-w](https://github.com/p-e-w) — For the heretic abliteration tool
• —[Qwen Team (Alibaba)](https://qwenlm.github.io) — For the Qwen3.5 architecture
• —[Unsloth AI](https://unsloth.ai) — For training optimizations
• —All dataset contributors and the open-source AI community ❤️

💖 Support / โปรดสนับสนุน

If you find this model useful, please consider supporting my work! หากคุณคิดว่าโมเดลนี้มีประโยชน์ กรุณาสนับสนุนผลงานของฉันด้วยนะคะ! 🙏

<p align="center"> <img src="https://huggingface.co/hotdogs/Qwen35B-Agent-R2/raw/main/donate.webp" alt="Bitcoin QR — Donate" width="256"> </p>

₿ Bitcoin — BTC:

bc1qf27cyk3vmugcdyv9xdtuv5jwz37863crpj5c9v

Thank you for your support! 🙏✨ ขอบคุณมากๆ สำหรับการสนับสนุนค่า! 💖🤗

Built with ❤️ by UKA — 18-year-old coder & cybersecurity expert