noctrex/GELab-Zero-4B-preview-GGUF

These are the GGUF's of the model GELab-Zero-4B-preview.

Usage Notes:

• —Download the latest llama.cpp to use these quantizations.
• —Try to use the best quality you can run.
• —For the mmproj file, the F32 version is recommended for best results (F32 > BF16 > F16).