CoolFace
Modelpublic

rsvalerio/codebert-base-coreml

sourceHugging Facemitupdated 6mo agoView on Hugging Face
0likes3downloads
Model Card

codebert-base — CoreML (.mlpackage)

CoreML conversion of microsoft/codebert-base for native Apple Neural Engine / GPU inference on macOS and iOS.

Files

FileDescription
model.mlpackage/CoreML model (FP16, flexible shapes)
tokenizer.jsonHF fast tokenizer

Details

  • Architecture: RoBERTa (encoder-only, no tokentypeids)
  • Precision: FP16 (native ANE precision)
  • Compute units: .all — CoreML schedules across ANE, GPU, and CPU
  • Input shapes: batch=1..512, seq_len=1..512 (flexible range)
  • Embedding dimension: 768

Usage with cai

bash
cai index --embed-backend swift --embed-model "rsvalerio/codebert-base-coreml"

The Swift backend downloads the .mlpackage from this repo, compiles it to .mlmodelc on first run (~30-60s), and caches the compiled model for subsequent runs.

Conversion

Converted using rsvalerio/models CI pipeline with coremltools.

bash
pip install coremltools transformers torch
python convert.py