Xingyu-Zheng/gemma-4-E4B-it-int8-foem

<div align="center"> <img src=https://ai.google.dev/gemma/images/gemma4_banner.png> </div> This is an unofficial quantized version of google/gemma-4-E4B-it.

🧠 Quantization Framework

GPTQModel

🗺️ Quantization Method

FOEM (AAAI 2026)

FOEM is an improved quantization method over GPTQ. The resulting model preserves the same inference structure as GPTQ, ensuring compatibility with existing deployment pipelines while achieving better accuracy.

📚 Calibration Dataset

We randomly sampled 512 examples from nohurry/Opus-4.6-Reasoning-3000x-filtered.

📋 Usage Example

This model can be deployed using standard frameworks such as vLLM and SGLang, just like other GPTQModel-quantized models.