CoolFace
Modelpublic

Novadata-Technologies/Reason-ModernColBERT-ONNX

sourceHugging Facemitupdated 6mo agoView on Hugging Face
0likes
README.md47 linesDownload Raw Back to root
1---2library_name: colbert-onnx3tags:4  - colbert5  - onnx6  - sentence-transformers7  - feature-extraction8license: mit9---10 11# Reason-ModernColBERT-ONNX12 13ONNX export of [lightonai/Reason-ModernColBERT](https://huggingface.co/lightonai/Reason-ModernColBERT) for fast CPU inference.14 15## Model Details16 17- **Source Model**: [lightonai/Reason-ModernColBERT](https://huggingface.co/lightonai/Reason-ModernColBERT)18- **Embedding Dimension**: 12819- **Format**: ONNX (FP32)20 21## Files22 23| File | Description |24|------|-------------|25| `model.onnx` | FP32 ONNX model |26 27| `tokenizer.json` | Tokenizer configuration |28| `config_sentence_transformers.json` | Model configuration |29 30## Usage with colbert-onnx (Rust)31 32```rust33use colbert_onnx::Colbert;34 35let mut model = Colbert::from_pretrained("path/to/model")?;36let embeddings = model.encode_documents(&["Hello world"])?;37```38 39## Export Tool40 41This model was exported using [pylate-onnx-export](https://github.com/lightonai/next-plaid/tree/main/onnx/python):42 43```bash44pip install "pylate-onnx-export @ git+https://github.com/lightonai/next-plaid.git#subdirectory=onnx/python"45pylate-onnx-export lightonai/Reason-ModernColBERT --push-to-hub Novadata-Technologies/Reason-ModernColBERT-ONNX46```47