Beinsezii/Equinox-gemma-4-31B-GGUF-5.05BPW
066
5.05 bpw, a mixture of Q5K and Q4K
This is a vRAM hog that barely fits ~32k CTX on a 24GiB GPU, or ~64k without mmproj. I'm not willing to go lower on quant and risk compromising capability.
5.05 bpw, a mixture of Q5K and Q4K
This is a vRAM hog that barely fits ~32k CTX on a 24GiB GPU, or ~64k without mmproj. I'm not willing to go lower on quant and risk compromising capability.