matrixportalx/Gemmasutra-Small-4B-v1-GGUF

Gemmasutra-Small-4B-v1 GGUF Quantized Models

Model Information

• —Base Model: TheDrummer/Gemmasutra-Small-4B-v1
• —Quantized by: matrixportal
• —Format: GGUF (for llama.cpp compatible tools)
• —Quantized on: 2025-04-09

Recommended Downloads

• —Q4_K_M: `gemmasutra-small-4b-v1.q4_k_m.gguf`
• —Q4_0: `gemmasutra-small-4b-v1.q4_0.gguf`
• —Q8_0: `gemmasutra-small-4b-v1.q8_0.gguf`

All Available Quantizations

Usage Instructions

1. 1.Download desired GGUF file
2. 2.Use with compatible tools:
3. 3.llama.cpp
4. 4.Ollama
5. 5.LM Studio
6. 6.GPT4All

💡 Tip: Q4KM offers the best balance for most use cases.