chmielvu/gemma-3-1b-cpu

Gemma 3 1B IT (Q4_0, CPU)

OpenAI-compatible API endpoint with Gradio UI running Google's official Gemma 3 1B QAT GGUF.

• —POST /v1/chat/completions — Chat completions (supports streaming)
• —GET /v1/models — List models
• —GET /health — Health check
• —GET /ready — Warm up model and confirm readiness

Based on google/gemma-3-1b-it-qat-q4_0-gguf — Google's own quantization-aware trained Q40 GGUF. Uses `chatformat="gemma"` for correct instruction format.

Config via env vars