raidenzeke/q4k4_models
116
Some of the Q4K4 quantized models I personally made. They can ONLY work on Ampere-optimized llama.cpp / ollama and will not work on anything else.
Some of the Q4K4 quantized models I personally made. They can ONLY work on Ampere-optimized llama.cpp / ollama and will not work on anything else.