oshkorinova/MamayLM-Gemma-3-12B-IT-v1.0-FP8-Dynamic
016
MamayLM Gemma 3 12B — FP8 Dynamic
FP8 static quantized from INSAIT-Institute/MamayLM-Gemma-3-12B-IT-v1.0 using llmcompressor.
Usage
- Designed for vLLM inference (H100).
trust_remote_code=True.
