CoolFace
Modelpublic

juliensimon/distilbert-amazon-shoe-reviews-onnx-quantized

sourceHugging Faceupdated 6mo agoView on Hugging Face
0likes14downloads
Model Card

DistilBERT Amazon Shoe Reviews — ONNX Quantized

Dynamically quantized ONNX export of juliensimon/distilbert-amazon-shoe-reviews for maximum CPU inference speed using Optimum.

Video walkthrough: Accelerate Transformer inference on CPU with Optimum and ONNX

Model Details

DetailValue
Base modeljuliensimon/distilbert-amazon-shoe-reviews
TaskStar rating prediction (1–5 stars) from shoe reviews
FormatONNX with dynamic quantization (INT8 weights)

Usage

python
from optimum.onnxruntime import ORTModelForSequenceClassification
from transformers import AutoTokenizer, pipeline

model = ORTModelForSequenceClassification.from_pretrained("juliensimon/distilbert-amazon-shoe-reviews-onnx-quantized")
tokenizer = AutoTokenizer.from_pretrained("juliensimon/distilbert-amazon-shoe-reviews-onnx-quantized")
classifier = pipeline("text-classification", model=model, tokenizer=tokenizer)

classifier("These shoes are incredibly comfortable!")

Related Models