koboldcpp/mmproj

This repo contains GGUF .mmproj files intended for use in KoboldCpp alongside other GGUF models.

Please pick the correct projector model to load for your architecture (e.g. all Mistral 7B based models should use the Mistral 7B projector.)

Load them in KoboldCpp with --mmproj or from the "Model Files" tab

When enabled, make sure you refresh KoboldAI Lite, then click Add Img and upload your image. Clicking that image should show Vision is enabled.