CoolFace
Modelpublic

barflyman/modernbert

sourceHugging Facemitupdated 10mo agoView on Hugging Face
2likes13downloads
Model Card

Evaluation Metrics

The table below summarizes the detailed evaluation results per PII label:

**Label****TP****FP****FN****Accuracy****Precision****Recall****F1 Score**
SURNAME372202899.25%100.0%99.25%99.63%
O (Non-PII)0400099.30%n/an/an/a
TIME193600100.0%100.0%100.0%100.0%
DRIVERLICENSENUM5050299.61%100.0%99.61%99.80%
PASSPORTNUM5640299.65%100.0%99.65%99.82%
GIVENNAME7548017297.77%100.0%97.77%98.87%
TELEPHONENUM364100100.0%100.0%100.0%100.0%
BUILDINGNUM40701995.54%100.0%95.54%97.72%
AGE1680199.41%100.0%99.41%99.70%
DATE233500100.0%100.0%100.0%100.0%
CITY1672013092.79%100.0%92.79%96.26%
TITLE34903590.89%100.0%90.89%95.23%
IDCARDNUM199802298.91%100.0%98.91%99.45%
GENDER12100100.0%100.0%100.0%100.0%
CREDITCARDNUMBER5570199.82%100.0%99.82%99.91%
SEX780198.73%100.0%98.73%99.36%
STREET136801998.63%100.0%98.63%99.31%
TAXNUM34501296.64%100.0%96.64%98.29%
EMAIL26060299.92%100.0%99.92%99.96%
SOCIALNUM41101197.39%100.0%97.39%98.68%
ZIPCODE40602095.31%100.0%95.31%97.60%

Overall Evaluation

  • —Accuracy: 99.01%
  • —Precision: 98.72%
  • —Recall: 98.47%
  • —F1 Score: 98.59%
  • —Total True Positives (TP): 30,737
  • —Total False Positives (FP): 400
  • —Total False Negatives (FN): 477

Macro-Averaged Metrics

  • —Accuracy: 98.35%
  • —Precision: 95.24%
  • —Recall: 93.35%
  • —F1 Score: 94.29%

Model Behavior & Limitations

  • —Evaluation Focus: The metrics shown above reflect performance on the test split of the open-pii-masking-500k-ai4privacy dataset. Real-world performance may vary and requires additional measures. Feel free to contact support@ai4privacy.com for assistance.

Disclaimer

This model card details the evaluation metrics and fine-tuning parameters for the multilingual anonymiser. Please note:

  • —The model is provided as-is under the MIT License.
  • —It is intended solely for redaction purposes and does not perform full PII classification.
  • —Users should carefully test and evaluate its performance on their own data before deploying in production environments.

Ai4Privacy – Committed to protecting personal data in the age of AI.