CoolFace
Modelpublic

prithivMLmods/Jan-v2-VL-f32-AIO-GGUF

sourceHugging Faceapache-2.0updated 11mo agoView on Hugging Face
3likes1.9kdownloads
Model Card

Jan-v2-VL-f32-AIO-GGUF

Jan-v2-VL is an 8-billion-parameter vision-language model designed for long-horizon, multi-step task execution in real software environments such as browsers and desktop applications. It tightly integrates language reasoning with visual perception to follow complex instructions, maintain intermediate states, and recover from minor execution errors, enabling stable and continuous task completion. The model is evaluated with a benchmark focused on long-horizon execution, confirming its strength in steady, low-drift stepwise operation. Jan-v2-VL comes in three variants—low (efficiency and lower latency), medium (balanced latency and quality), and high (deeper reasoning with higher think time)—to best suit different performance needs. It supports agentic automation and UI control via screenshot grounding and tool calls and is optimized for local deployment with popular frameworks like vLLM and llama.cpp, offering a powerful tool for automation and interaction tasks in complex visual and textual environments.

Models

Jan-v2-VL-high

File NameQuant TypeFile Size
Jan-v2-VL-high-BF16.ggufBF1616.4 GB
Jan-v2-VL-high-F16.ggufF1616.4 GB
Jan-v2-VL-high-F32.ggufF3232.8 GB
Jan-v2-VL-high-Q3KL.ggufQ3KL4.43 GB
Jan-v2-VL-high-Q3KM.ggufQ3KM4.12 GB
Jan-v2-VL-high-Q3KS.ggufQ3KS3.77 GB
Jan-v2-VL-high-Q4_0.ggufQ4_04.77 GB
Jan-v2-VL-high-Q4_1.ggufQ4_15.25 GB
Jan-v2-VL-high-Q4KM.ggufQ4KM5.03 GB
Jan-v2-VL-high-Q4KS.ggufQ4KS4.8 GB
Jan-v2-VL-high-Q5_0.ggufQ5_05.72 GB
Jan-v2-VL-high-Q5_1.ggufQ5_16.19 GB
Jan-v2-VL-high-Q5KM.ggufQ5KM5.85 GB
Jan-v2-VL-high-Q5KS.ggufQ5KS5.72 GB
Jan-v2-VL-high-Q6_K.ggufQ6_K6.73 GB
Jan-v2-VL-high-Q8_0.ggufQ8_08.71 GB
Jan-v2-VL-high-mmproj-bf16.ggufmmproj-bf161.16 GB
Jan-v2-VL-high-mmproj-f16.ggufmmproj-f161.16 GB
Jan-v2-VL-high-mmproj-f32.ggufmmproj-f322.31 GB
Jan-v2-VL-high-mmproj-q8_0.ggufmmproj-q8_0752 MB
Jan-v2-VL-high.i1-IQ1_M.ggufi1-IQ1_M2.26 GB
Jan-v2-VL-high.i1-IQ1_S.ggufi1-IQ1_S2.12 GB
Jan-v2-VL-high.i1-IQ2_M.ggufi1-IQ2_M3.05 GB
Jan-v2-VL-high.i1-IQ2_S.ggufi1-IQ2_S2.86 GB
Jan-v2-VL-high.i1-IQ2_XS.ggufi1-IQ2_XS2.7 GB
Jan-v2-VL-high.i1-IQ2_XXS.ggufi1-IQ2_XXS2.49 GB
Jan-v2-VL-high.i1-IQ3_M.ggufi1-IQ3_M3.9 GB
Jan-v2-VL-high.i1-IQ3_S.ggufi1-IQ3_S3.79 GB
Jan-v2-VL-high.i1-IQ3_XS.ggufi1-IQ3_XS3.63 GB
Jan-v2-VL-high.i1-IQ3_XXS.ggufi1-IQ3_XXS3.37 GB
Jan-v2-VL-high.i1-IQ4_NL.ggufi1-IQ4_NL4.79 GB
Jan-v2-VL-high.i1-IQ4_XS.ggufi1-IQ4_XS4.56 GB
Jan-v2-VL-high.i1-Q2_K.ggufi1-Q2_K3.28 GB
Jan-v2-VL-high.i1-Q2KS.ggufi1-Q2KS3.08 GB
Jan-v2-VL-high.i1-Q3KL.ggufi1-Q3KL4.43 GB
Jan-v2-VL-high.i1-Q3KM.ggufi1-Q3KM4.12 GB
Jan-v2-VL-high.i1-Q3KS.ggufi1-Q3KS3.77 GB
Jan-v2-VL-high.i1-Q4_0.ggufi1-Q4_04.79 GB
Jan-v2-VL-high.i1-Q4_1.ggufi1-Q4_15.25 GB
Jan-v2-VL-high.i1-Q4KM.ggufi1-Q4KM5.03 GB
Jan-v2-VL-high.i1-Q4KS.ggufi1-Q4KS4.8 GB
Jan-v2-VL-high.i1-Q5KM.ggufi1-Q5KM5.85 GB
Jan-v2-VL-high.i1-Q5KS.ggufi1-Q5KS5.72 GB
Jan-v2-VL-high.i1-Q6_K.ggufi1-Q6_K6.73 GB
Jan-v2-VL-high.imatrix.ggufimatrix5.35 MB

Jan-v2-VL-med

File NameQuant TypeFile Size
Jan-v2-VL-med-BF16.ggufBF1616.4 GB
Jan-v2-VL-med-F16.ggufF1616.4 GB
Jan-v2-VL-med-F32.ggufF3232.8 GB
Jan-v2-VL-med-Q3KL.ggufQ3KL4.43 GB
Jan-v2-VL-med-Q3KM.ggufQ3KM4.12 GB
Jan-v2-VL-med-Q3KS.ggufQ3KS3.77 GB
Jan-v2-VL-med-Q4_0.ggufQ4_04.77 GB
Jan-v2-VL-med-Q4_1.ggufQ4_15.25 GB
Jan-v2-VL-med-Q4KM.ggufQ4KM5.03 GB
Jan-v2-VL-med-Q4KS.ggufQ4KS4.8 GB
Jan-v2-VL-med-Q5_0.ggufQ5_05.72 GB
Jan-v2-VL-med-Q5_1.ggufQ5_16.19 GB
Jan-v2-VL-med-Q5KM.ggufQ5KM5.85 GB
Jan-v2-VL-med-Q5KS.ggufQ5KS5.72 GB
Jan-v2-VL-med-Q6_K.ggufQ6_K6.73 GB
Jan-v2-VL-med-Q8_0.ggufQ8_08.71 GB
Jan-v2-VL-med-mmproj-bf16.ggufmmproj-bf161.16 GB
Jan-v2-VL-med-mmproj-f16.ggufmmproj-f161.16 GB
Jan-v2-VL-med-mmproj-f32.ggufmmproj-f322.31 GB
Jan-v2-VL-med-mmproj-q8_0.ggufmmproj-q8_0752 MB
Jan-v2-VL-med.i1-IQ1_M.ggufi1-IQ1_M2.26 GB
Jan-v2-VL-med.i1-IQ1_S.ggufi1-IQ1_S2.12 GB
Jan-v2-VL-med.i1-IQ2_M.ggufi1-IQ2_M3.05 GB
Jan-v2-VL-med.i1-IQ2_S.ggufi1-IQ2_S2.86 GB
Jan-v2-VL-med.i1-IQ2_XS.ggufi1-IQ2_XS2.7 GB
Jan-v2-VL-med.i1-IQ2_XXS.ggufi1-IQ2_XXS2.49 GB
Jan-v2-VL-med.i1-IQ3_M.ggufi1-IQ3_M3.9 GB
Jan-v2-VL-med.i1-IQ3_S.ggufi1-IQ3_S3.79 GB
Jan-v2-VL-med.i1-IQ3_XS.ggufi1-IQ3_XS3.63 GB
Jan-v2-VL-med.i1-IQ3_XXS.ggufi1-IQ3_XXS3.37 GB
Jan-v2-VL-med.i1-IQ4_NL.ggufi1-IQ4_NL4.79 GB
Jan-v2-VL-med.i1-IQ4_XS.ggufi1-IQ4_XS4.56 GB
Jan-v2-VL-med.i1-Q2_K.ggufi1-Q2_K3.28 GB
Jan-v2-VL-med.i1-Q2KS.ggufi1-Q2KS3.08 GB
Jan-v2-VL-med.i1-Q3KL.ggufi1-Q3KL4.43 GB
Jan-v2-VL-med.i1-Q3KM.ggufi1-Q3KM4.12 GB
Jan-v2-VL-med.i1-Q3KS.ggufi1-Q3KS3.77 GB
Jan-v2-VL-med.i1-Q4_0.ggufi1-Q4_04.79 GB
Jan-v2-VL-med.i1-Q4_1.ggufi1-Q4_15.25 GB
Jan-v2-VL-med.i1-Q4KM.ggufi1-Q4KM5.03 GB
Jan-v2-VL-med.i1-Q4KS.ggufi1-Q4KS4.8 GB
Jan-v2-VL-med.i1-Q5KM.ggufi1-Q5KM5.85 GB
Jan-v2-VL-med.i1-Q5KS.ggufi1-Q5KS5.72 GB
Jan-v2-VL-med.i1-Q6_K.ggufi1-Q6_K6.73 GB
Jan-v2-VL-med.imatrix.ggufimatrix5.35 MB

Jan-v2-VL-low

File NameQuant TypeFile Size
Jan-v2-VL-low-BF16.ggufBF1616.4 GB
Jan-v2-VL-low-F16.ggufF1616.4 GB
Jan-v2-VL-low-F32.ggufF3232.8 GB
Jan-v2-VL-low-Q3KL.ggufQ3KL4.43 GB
Jan-v2-VL-low-Q3KM.ggufQ3KM4.12 GB
Jan-v2-VL-low-Q3KS.ggufQ3KS3.77 GB
Jan-v2-VL-low-Q4_0.ggufQ4_04.77 GB
Jan-v2-VL-low-Q4_1.ggufQ4_15.25 GB
Jan-v2-VL-low-Q4KM.ggufQ4KM5.03 GB
Jan-v2-VL-low-Q4KS.ggufQ4KS4.8 GB
Jan-v2-VL-low-Q5_0.ggufQ5_05.72 GB
Jan-v2-VL-low-Q5_1.ggufQ5_16.19 GB
Jan-v2-VL-low-Q5KM.ggufQ5KM5.85 GB
Jan-v2-VL-low-Q5KS.ggufQ5KS5.72 GB
Jan-v2-VL-low-Q6_K.ggufQ6_K6.73 GB
Jan-v2-VL-low-Q8_0.ggufQ8_08.71 GB
Jan-v2-VL-low-mmproj-bf16.ggufmmproj-bf161.16 GB
Jan-v2-VL-low-mmproj-f16.ggufmmproj-f161.16 GB
Jan-v2-VL-low-mmproj-f32.ggufmmproj-f322.31 GB
Jan-v2-VL-low-mmproj-q8_0.ggufmmproj-q8_0752 MB

Quants Usage

(sorted by size, not necessarily quality. IQ-quants are often preferable over similar sized non-IQ quants)

Here is a handy graph by ikawrakow comparing some lower-quality quant types (lower is better):

image.png