Modelpublic

Zenabius/granite-embedding-reranker-english-r2

sourceHugging Faceupdated 11mo agoView on Hugging Face

0likes13downloads

Model Card

ONNX Model

Converted from: granite-embedding-reranker-english-r2

Files

—model.onnx - FP32 version
—model_quantized.onnx - INT8 quantized version
—*.json - tokenizer and config files

Usage

python

from transformers import AutoTokenizer
import onnxruntime as ort

tokenizer = AutoTokenizer.from_pretrained("granite-onnx")
session = ort.InferenceSession("granite-onnx/model_quantized.onnx")