temsa/OpenMed-mLiteClinical-IrishCorePII-135M-v2-rc5

OpenMed-mLiteClinical-IrishCorePII-135M-v2-rc5

Token-classification checkpoint for Irish core PII in English and Irish Gaelic.

Included Variants

• —Full transformers checkpoint in the repo root
• —Unquantized ONNX export in onnx/model.onnx
• —Dynamic q8 ONNX artifact in onnx/model_quantized.onnx
• —inference_mask.py for the full checkpoint
• —inference_mask_onnx.py for the ONNX q8 artifact
• —benchmark files in eval/

Coverage

• —PPSN
• —ACCOUNT_NUMBER
• —BANK_ROUTING_NUMBER
• —CREDIT_DEBIT_CARD
• —PASSPORT_NUMBER
• —POSTCODE
• —PHONE_NUMBER
• —EMAIL
• —FIRST_NAME
• —LAST_NAME
• —SWIFT_BIC

What Changed From rc4

rc5 keeps the same fine-tuned checkpoint weights as temsa/OpenMed-mLiteClinical-IrishCorePII-135M-v2-rc4, but changes the shipped inference stack:

• —recommended PPSN threshold lowered from 0.71 to 0.55
• —recommended decoder is now the Irish core label-aware repair decoder for both full and q8 inference
• —bundled q8 artifact is rebuilt from a preprocessed ONNX export before dynamic int8 quantization

This is the right change because the new QA misses in Gaelic weak-context PPSN text were calibration/inference failures, not weight-quality failures.

Recommended Inference

Full checkpoint:

uv run python inference_mask.py \
  --model temsa/OpenMed-mLiteClinical-IrishCorePII-135M-v2-rc5 \
  --ppsn-min-score 0.55 \
  --other-min-score 0.50 \
  --text "Duradh liom mo uimhir 1234567T a sholatar agus me ag denamh iarratais." \
  --json

Dynamic q8 ONNX:

uv run python inference_mask_onnx.py \
  --model temsa/OpenMed-mLiteClinical-IrishCorePII-135M-v2-rc5 \
  --onnx-file onnx/model_quantized.onnx \
  --ppsn-min-score 0.55 \
  --other-min-score 0.50 \
  --text "Is e mo upsp na 1234567tw agus teastaionn uaim eolas faoi liuntas curamora." \
  --json

The bundled pyproject.toml is intended for uv. Use uv run so onnxruntime is available for the q8 script.

Key Benchmarks

Fix For The Reported Gaelic PPSN Regression

Base OpenMed vs rc5

Core Label Breakdown

Dynamic q8 Artifact

Artifact paths:

• —unquantized: onnx/model.onnx
• —quantized: onnx/model_quantized.onnx

Quantization recipe used in this repo:

• —ONNX pre-processing before quantization
• —ONNX Runtime dynamic int8
• —qint8
• —per_channel=true
• —op_types=MatMul,Gemm,Attention

This q8 path keeps the same F1 as the best prior q8 recipe on the sampled comparison suites while improving CPU throughput on the manual Irish-core suites.

CPU Throughput

Limits

• —The full checkpoint is still stronger than q8 on the finance-boundary suite.
• —The q8 artifact is still weaker than the full checkpoint on the strict remaining-gap suite.
• —Grouped credit/debit-card boundary cases remain the main shared weakness and should still be QA tested.

License And Attribution

• —Release license: Apache-2.0
• —Base model: OpenMed/OpenMed-PII-mLiteClinical-Base-135M-v1
• —See NOTICE and training_sources.json for attribution and release details.

<!-- portfolio-comparison:start -->

Portfolio Comparison

Updated: 2026-03-16.

Use this section for the fastest public comparison across the temsa PII masking portfolio.

• —The first core table only includes public checkpoints that ship both comparable q8 accuracy and q8 CPU throughput.
• —The first PPSN table only includes public artifacts that ship comparable PPSN accuracy and CPU throughput.
• —Missing cells in the archive tables mean the older release did not ship that metric in its public bundle.
• —DiffMask rows use the reconciled clean_single_pass harness that matches the deployed runtime.
• —GlobalPointer rows use the public raw-only span-matrix release bundle and its packaged q8 ONNX artifact.
• —The same content is shipped as PORTFOLIO_COMPARISON.md inside each public model repo.

Irish Core PII: Comparable Public Checkpoints

Irish Core PII: Other Public Checkpoints

Finance-boundary q8 F1 is 1.0000 for OpenMed-mLiteClinical-IrishCorePII-135M-v2-rc6, OpenMed-mLiteClinical-IrishCorePII-135M-v2-rc7, OpenMed-mLiteClinical-IrishCorePII-135M-v2-rc8, and all public IrishCore-DiffMask releases from rc1 to rc6. OpenMed-mLiteClinical-IrishCorePII-135M-v2-rc5 ships 0.8750 on that public q8 suite.

PPSN-Only: Comparable Public Artifacts

PPSN-Only: Historical Public Checkpoints

If you need the strongest current raw-only Irish core model, start with IrishCore-GlobalPointer-135M-v1-rc4. If you need the fastest CPU-first raw-only line, compare it against IrishCore-DiffMask-135M-v1-rc6. If you need a PPSN-only artifact, compare the canonical fp32, fp16, and q8 variants of OpenMed-mLiteClinical-IrishPPSN-135M-v1 directly in the table above. <!-- portfolio-comparison:end -->