CoolFace
Modelpublic

prithivMLmods/LensVLM-9B-GGUF

sourceHugging Faceapple-amlrupdated 2d agoView on Hugging Face
4likes589downloads
Model Card

LensVLM-9B-GGUF

LensVLM-9B is a 9-billion-parameter vision-language model from Apple, built on Qwen3.5-9B, introduced in the paper "LensVLM: Selective Context Expansion for Compressed Visual Representation of Text." Its core mechanism scans a compressed image representation of text — at configurable compression ratios of 5x, 10x, or 15x — and then selectively expands only the pages relevant to a given question back to their uncompressed form via learned tools, allowing the model to process very long documents without holding the entire uncompressed text in context. It's run via the accompanying ml-lensvlm codebase with a simple demo script accepting a text file and a question, and is released under the Apple Machine Learning Research Model License (with the accompanying source code separately licensed under the Apple Sample Code License).

Model Files

File NameQuant TypeFile SizeFile LinkDescription
LensVLM-9B.BF16.ggufBF1617.9 GBLinkFull BF16 weights. Highest quality, largest file size.
LensVLM-9B.Q3KL.ggufQ3KL4.93 GBLinkLower quality but usable, good for low RAM availability.
LensVLM-9B.Q3KM.ggufQ3KM4.62 GBLinkLow quality.
LensVLM-9B.Q4KM.ggufQ4KM5.63 GBLinkGood quality, default size for most use cases, recommended.
LensVLM-9B.Q4KS.ggufQ4KS5.35 GBLinkSlightly lower quality with more space savings, recommended.
LensVLM-9B.Q5KM.ggufQ5KM6.47 GBLinkHigh quality, recommended.
LensVLM-9B.Q5KS.ggufQ5KS6.31 GBLinkHigh quality, recommended.
LensVLM-9B.Q6_K.ggufQ6_K7.36 GBLinkVery high quality, near perfect, recommended.
LensVLM-9B.mmproj-bf16.ggufmmproj-bf16922 MBLinkMultimodal projection file in BF16 format. Used for vision/language models.

llama.cpp

LLM inference in C/C++ — https://github.com/ggml-org/llama.cpp