noctrex/LightOnOCR-2-1B-bbox-soup-GGUF

This are the quantizations of the model LightOnOCR-2-1B-bbox-soup

Try to use the best quality you can run.

Quality order: BF16 > F16 > Q80 > Q6K > Q5KM > IQ4NL > IQ4XS > Q4KM

For the mmproj, try to use the F32 version as it will produce the best results. Quality order: F32 > BF16 > F16