CoolFace
Modelpublic

temsa/IrishCore-GlobalPointer-ContextPII-135M-v1-rc21

sourceHugging Faceapache-2.0updated 6mo agoView on Hugging Face
0likes18downloads
Model Card

IrishCore-GlobalPointer-ContextPII-135M-v1-rc21

IrishCore-GlobalPointer-ContextPII-135M-v1-rc21 is the current expanded-label raw-only PII masking release for Irish public-sector, HSE, and citizen-support flows.

It keeps the same DistilBERT-size GlobalPointer span extractor family and the same weights as temsa/IrishCore-GlobalPointer-ContextPII-135M-v1-rc20, but ships a stronger bundled decoder for multiline contextual Irish/English address, location, name, and date-of-birth recovery while preserving the fast q8 CPU deployment path.

Context labels served by this line:

  • —STREET_ADDRESS
  • —CITY
  • —COUNTY
  • —DATE_OF_BIRTH
  • —AGE

Core labels retained:

  • —PPSN
  • —POSTCODE
  • —PHONE_NUMBER
  • —EMAIL
  • —PASSPORT_NUMBER
  • —ACCOUNT_NUMBER
  • —BANK_ROUTING_NUMBER
  • —SWIFT_BIC
  • —CREDIT_DEBIT_CARD
  • —FIRST_NAME
  • —LAST_NAME

Positioning

rc21 is a decoder/runtime hardening release over rc20.

  • —weights unchanged
  • —ONNX graph unchanged
  • —no external scanner or validator added
  • —deployment path still single-pass span extraction plus deterministic [PII:LABEL] replacement

What changed in rc21:

  • —contextual name extraction now stops at line breaks once a field value has started, so multiline forms do not leak into the next line
  • —multiline Address line 1 values such as Árasán 4, Teach an Ché are recovered as STREET_ADDRESS even when the first line has no street suffix yet
  • —DATE_OF_BIRTH repair now separates true DOB cues from appointment dates while still recovering date-before-cue phrasing like 03/02/1991 mo dháta breithe
  • —COUNTY repair now rejects office-style false positives such as County Hall while preserving real county forms
  • —fresh unseen contextual holdouts v12, v13, v14, and v15 all score 1.0000 exact F1 on the q8 deployment path

If you only need the narrower Irish-core structured label set and want maximum CPU throughput, temsa/IrishCore-GlobalPointer-135M-v1-rc4 remains the faster option.

Benchmarks

ONNX q8

SuiteF1Examples/s
Irish core1.0000150.7792
Irish extended1.0000133.0167
Gov contact policy v11.0000151.9706
Gov chatbot red-team v20.9861115.6955
Gov chatbot gap holdout v21.0000116.6859
Context red-team v11 exact1.0000181.8048
Context holdout v12 exact1.0000139.7926
Context holdout v13 exact1.0000119.2885
Context holdout v14 exact1.000078.7087
Context holdout v15 exact1.000059.6818
Multilingual PPSN overall0.9333188.5168
Multilingual PPSN label-only1.0000—

Comparison

ModelIrish core q8 F1Gov chatbot gap holdout v2 q8 F1Context holdout v15 exact q8 F1Q8 core examples/s
ContextPII rc21 q81.00001.00001.0000150.7792
ContextPII rc20 q81.00001.00001.0000181.8821
ContextPII rc19 q81.00001.0000—73.0554
ContextPII rc18 q81.00001.0000—111.3135
GlobalPointer core rc4 q81.00001.0000—221.5743

Evaluation Notes

Additional q8 release checks shipped in this repo:

  • —eval/q8_globalpointer_context_redteam_v11_exact.json: legacy exact-boundary contextual regression suite, now 1.0000
  • —eval/q8_globalpointer_context_holdout_v12_exact.json: fresh unseen holdout for prefixed Irish/English address recovery, now 1.0000
  • —eval/q8_globalpointer_context_holdout_v13_exact.json: fresh unseen holdout for house-name and city/county field recovery, now 1.0000
  • —eval/q8_globalpointer_context_holdout_v14_exact.json: fresh unseen holdout for Gaelic surname-particle names, apostrophe surnames after self-cues, and mixed structured/contextual packets, now 1.0000
  • —eval/q8_globalpointer_context_holdout_v15_exact.json: fresh unseen holdout for multiline form fields, line-1 prefix addresses, date-before-cue DOBs, appointment-vs-DOB disambiguation, and code-switched address turns, now 1.0000
  • —eval/q8_irish_gov_chatbot_gap_holdout_v2.json: legacy chatbot gap suite, now 1.0000

Known tradeoff:

  • —eval/q8_irish_gov_chatbot_redteam_v2.json remains 0.9861 because this broader contextual release masks public-office street/city details in assistant text, while that older suite only labels postcode and phone there.

Usage

bash
python3 inference_mask_onnx.py --model temsa/IrishCore-GlobalPointer-ContextPII-135M-v1-rc21 --text "My name is Maeve O'Sullivan, my PPSN is 1234567T, and my address is Árasán 4, Cedar Court, mBaile Átha Cliath, D08 XY12."

<!-- portfolio-comparison:start -->

Portfolio Comparison

Updated: 2026-03-16.

Use this section for the fastest public comparison across the temsa PII masking portfolio.

  • —The first core table only includes public checkpoints that ship both comparable q8 accuracy and q8 CPU throughput.
  • —The first PPSN table only includes public artifacts that ship comparable PPSN accuracy and CPU throughput.
  • —Missing cells in the archive tables mean the older release did not ship that metric in its public bundle.
  • —DiffMask rows use the reconciled clean_single_pass harness that matches the deployed runtime.
  • —GlobalPointer rows use the public raw-only span-matrix release bundle and its packaged q8 ONNX artifact.
  • —The same content is shipped as PORTFOLIO_COMPARISON.md inside each public model repo.

Irish Core PII: Comparable Public Checkpoints

RepoStackFull Core F1Q8 Core F1Q8 Multilingual PPSN F1Q8 Core ex/s
`temsa/IrishCore-GlobalPointer-ContextPII-4L-122M-v1-rc6`4-layer GlobalPointer distilled fast student1.00001.00000.9333282.9
`temsa/IrishCore-GlobalPointer-ContextPII-4L-122M-v1-rc5`4-layer GlobalPointer distilled fast student1.00001.00000.9333282.9
`temsa/IrishCore-GlobalPointer-ContextPII-4L-122M-v1-rc3`4-layer GlobalPointer distilled fast student1.00001.00000.9333317.9
`temsa/IrishCore-GlobalPointer-ContextPII-4L-122M-v1-rc2`4-layer GlobalPointer distilled fast student1.00001.00000.9333292.5
`temsa/IrishCore-GlobalPointer-ContextPII-4L-122M-v1-rc1`4-layer GlobalPointer distilled fast student1.00001.00000.9333337.3
`temsa/IrishCore-GlobalPointer-ContextPII-135M-v1-rc29`GlobalPointer raw-only + context labels1.00001.00000.9333232.7
`temsa/IrishCore-GlobalPointer-ContextPII-135M-v1-rc28`GlobalPointer raw-only + context labels1.00001.00000.9333232.7
`temsa/IrishCore-GlobalPointer-ContextPII-135M-v1-rc25`GlobalPointer raw-only + context labels1.00001.00000.9333212.1
`temsa/IrishCore-GlobalPointer-ContextPII-135M-v1-rc24`GlobalPointer raw-only + context labels1.00001.00000.9333278.9
`temsa/IrishCore-GlobalPointer-ContextPII-135M-v1-rc23`GlobalPointer raw-only + context labels1.00001.00000.9333237.6
`temsa/IrishCore-GlobalPointer-ContextPII-135M-v1-rc22`GlobalPointer raw-only + context labels1.00001.00000.9333106.8
`temsa/IrishCore-GlobalPointer-ContextPII-135M-v1-rc21`GlobalPointer raw-only + context labels1.00001.00000.9333150.8
`temsa/IrishCore-GlobalPointer-ContextPII-135M-v1-rc20`GlobalPointer raw-only + context labels1.00001.00000.9333181.9
`temsa/IrishCore-GlobalPointer-ContextPII-135M-v1-rc19`GlobalPointer raw-only + context labels1.00001.00000.933373.1
`temsa/IrishCore-GlobalPointer-ContextPII-135M-v1-rc18`GlobalPointer raw-only + context labels1.00001.00000.9333126.2
`temsa/IrishCore-GlobalPointer-ContextPII-135M-v1-rc17`GlobalPointer raw-only + context labels1.00001.00000.9333125.5
`temsa/IrishCore-GlobalPointer-ContextPII-135M-v1-rc16`GlobalPointer raw-only + context labels1.00001.00000.9333125.5
`temsa/IrishCore-GlobalPointer-ContextPII-135M-v1-rc15`GlobalPointer raw-only + context labels1.00001.00000.9333125.5
`temsa/IrishCore-GlobalPointer-ContextPII-135M-v1-rc14`GlobalPointer raw-only + context labels1.00001.00000.9333119.2
`temsa/IrishCore-GlobalPointer-ContextPII-135M-v1-rc13`GlobalPointer raw-only + context labels1.00001.00000.9333126.1
`temsa/IrishCore-GlobalPointer-ContextPII-135M-v1-rc12`GlobalPointer raw-only + context labels1.00001.00000.933373.6
`temsa/IrishCore-GlobalPointer-ContextPII-135M-v1-rc11`GlobalPointer raw-only + context labels1.00001.00000.933394.1
`temsa/IrishCore-GlobalPointer-ContextPII-135M-v1-rc10`GlobalPointer raw-only + context labels1.00001.00000.9333125.8
`temsa/IrishCore-GlobalPointer-ContextPII-135M-v1-rc9`GlobalPointer raw-only + context labels1.00001.00000.9333119.8
`temsa/IrishCore-GlobalPointer-ContextPII-135M-v1-rc8`GlobalPointer raw-only + context labels1.00001.00000.9333128.9
`temsa/IrishCore-GlobalPointer-ContextPII-135M-v1-rc7`GlobalPointer raw-only + context labels1.00001.00000.933389.0
`temsa/IrishCore-GlobalPointer-ContextPII-135M-v1-rc6`GlobalPointer raw-only + context labels1.00001.00000.933389.0
`temsa/IrishCore-GlobalPointer-ContextPII-135M-v1-rc5`GlobalPointer raw-only + context labels1.00001.00000.933384.5
`temsa/IrishCore-GlobalPointer-ContextPII-135M-v1-rc4`GlobalPointer raw-only + context labels0.99350.99350.933361.5
`temsa/IrishCore-GlobalPointer-ContextPII-135M-v1-rc3`GlobalPointer raw-only + context labels0.99350.99350.933361.5
`temsa/IrishCore-GlobalPointer-ContextPII-135M-v1-rc2`GlobalPointer raw-only + context labels0.99350.99350.922261.5
`temsa/IrishCore-GlobalPointer-ContextPII-135M-v1-rc1`GlobalPointer raw-only + context labels0.99350.99350.922261.5
`temsa/IrishCore-GlobalPointer-135M-v1-rc4`GlobalPointer raw-only span-matrix1.00001.00000.9333221.6
`temsa/IrishCore-GlobalPointer-135M-v1-rc3`GlobalPointer raw-only span-matrix1.00001.00000.9213204.9
`temsa/IrishCore-GlobalPointer-135M-v1-rc2`GlobalPointer raw-only span-matrix0.99340.99340.9326231.2
`temsa/OpenMed-mLiteClinical-IrishCorePII-135M-v2-rc8`Raw-only token-span0.97370.97370.917646.1
`temsa/OpenMed-mLiteClinical-IrishCorePII-135M-v2-rc7`Hybrid classifier + generated scanner spec1.00000.99341.000030.0
`temsa/OpenMed-mLiteClinical-IrishCorePII-135M-v2-rc6`Hybrid classifier + repair decoders1.00000.99341.000029.5
`temsa/OpenMed-mLiteClinical-IrishCorePII-135M-v2-rc5`Hybrid classifier + repair decoders0.97370.96690.933334.4
`temsa/OpenMed-mLiteClinical-IrishCorePII-135M-v2-rc4`Hybrid classifier + repair decoders0.98700.97400.9600114.2
`temsa/OpenMed-mLiteClinical-IrishCorePII-135M-v2-rc3`Hybrid classifier + repair decoders0.98060.96770.933344.9
`temsa/OpenMed-mLiteClinical-IrishCorePII-135M-v2-rc2`Hybrid classifier + repair decoders0.95540.96150.7887119.1
`temsa/OpenMed-mLiteClinical-IrishCorePII-135M-v1`Hybrid classifier baseline0.95300.93330.9882103.3
`temsa/IrishCore-DiffMask-135M-v1-rc6`DiffMask token-span, scanner-free0.98010.97330.9274130.3
`temsa/IrishCore-DiffMask-135M-v1-rc5`DiffMask token-span, scanner-free0.97330.97330.9379249.2
`temsa/IrishCore-DiffMask-135M-v1-rc4`DiffMask token-span, scanner-free0.97330.97330.937129.5
`temsa/IrishCore-DiffMask-135M-v1-rc3`DiffMask token-span, scanner-free0.96640.96640.959130.0
`temsa/IrishCore-DiffMask-135M-v1-rc2`DiffMask token-span, scanner-free0.96640.96640.9212247.1
`temsa/IrishCore-DiffMask-135M-v1-rc1`DiffMask token-span, scanner-free0.98010.99340.9412251.2

Irish Core PII: Other Public Checkpoints

RepoStackFull Core F1Q8 Core F1Q8 Multilingual PPSN F1Notes
`temsa/OpenMed-mLiteClinical-IrishCorePII-135M-v2-rc1`Hybrid classifier prototype0.9487——Predates the public q8 artifact.

Finance-boundary q8 F1 is 1.0000 for OpenMed-mLiteClinical-IrishCorePII-135M-v2-rc6, OpenMed-mLiteClinical-IrishCorePII-135M-v2-rc7, OpenMed-mLiteClinical-IrishCorePII-135M-v2-rc8, and all public IrishCore-DiffMask releases from rc1 to rc6. OpenMed-mLiteClinical-IrishCorePII-135M-v2-rc5 ships 0.8750 on that public q8 suite.

PPSN-Only: Comparable Public Artifacts

RepoArtifactIrish Large F1Multilingual PPSN F1User Raw F1QA v8 F1CPU ex/s
`temsa/OpenMed-mLiteClinical-IrishPPSN-135M-v1`fp32 canonical checkpoint0.89790.97040.80000.738557.4
`temsa/OpenMed-mLiteClinical-IrishPPSN-135M-v1-fp16`fp16 CPU/GPU artifact—0.97040.80000.738545.8
`temsa/OpenMed-mLiteClinical-IrishPPSN-135M-v1-q8`dynamic int8 CPU artifact—0.9040——132.1

PPSN-Only: Historical Public Checkpoints

RepoMain Published MetricsNotes
`temsa/OpenMed-PPSN-mLiteClinical-v1`same as canonical fp32 repo: multilingual 0.9704, user raw 0.8000Legacy alias; prefer temsa/OpenMed-mLiteClinical-IrishPPSN-135M-v1.
`temsa/OpenMed-PPSN-v6-raw-rc2`irishregv5 0.8750; userraw 0.8000; qav8 0.7385Raw PPSN-only research checkpoint; no packaged multilingual CPU benchmark row.
`temsa/OpenMed-PPSN-v5_1`irishlargev2 raw 0.9285; qa_v6 hybrid strict 1.0000Hybrid PPSN-only checkpoint; predates the canonical multilingual suite packaging.
`temsa/OpenMed-PPSN-v5`irishregv5 raw 0.8235; irishregv5 hybrid strict 1.0000Hybrid PPSN-only checkpoint; predates the canonical multilingual suite packaging.
`temsa/OpenMed-PPSN-v4`synthetic non-PPSN drift check onlyPredates the current PPSN eval suite; no packaged apples-to-apples multilingual CPU row.

If you need the strongest current raw-only Irish core model, start with IrishCore-GlobalPointer-135M-v1-rc4. If you need the fastest CPU-first raw-only line, compare it against IrishCore-DiffMask-135M-v1-rc6. If you need a PPSN-only artifact, compare the canonical fp32, fp16, and q8 variants of OpenMed-mLiteClinical-IrishPPSN-135M-v1 directly in the table above. <!-- portfolio-comparison:end -->