Modelpublic

echarlaix/SmolVLM2-256M-Video-Instruct-openvino-8bit-woq-data-free

sourceHugging Faceapache-2.0updated 1y agoView on Hugging Face

0likes62downloads

Model Card

This model is a quantized version of `echarlaix/SmolVLM2-256M-Video-Instruct-openvino` and is converted to the OpenVINO format. This model was obtained via the nncf-quantization space with optimum-intel.

First make sure you have optimum-intel installed:

bash

pip install optimum[openvino]

To load your model you can do as follows:

python

from optimum.intel import OVModelForVisualCausalLM

model_id = "echarlaix/SmolVLM2-256M-Video-Instruct-openvino-8bit-woq-data-free"
model = OVModelForVisualCausalLM.from_pretrained(model_id)