CoolFace
Modelpublic

selsar/nli-professional-status

sourceHugging Faceapache-2.0updated 1y agoView on Hugging Face
0likes20downloads
Model Card

<!-- This model card has been generated automatically according to the information the Trainer had access to. You should probably proofread and complete it, then remove this comment. -->

nli-professional-status

This model is a fine-tuned version of EuroBERT/EuroBERT-610m on the None dataset. It achieves the following results on the evaluation set:

  • —Loss: 0.5105
  • —Accuracy: 0.8906
  • —Precision Binary: 0.5169
  • —Recall Binary: 0.3770
  • —F1 Binary: 0.4360
  • —Precision Micro: 0.8906
  • —Recall Micro: 0.8906
  • —F1 Micro: 0.8906
  • —F1 Macro: 0.6877
  • —Pr Auc: 0.8671
  • —Cohen Kappa: 0.3771

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

  • —learning_rate: 2e-05
  • —trainbatchsize: 8
  • —evalbatchsize: 8
  • —seed: 42
  • —optimizer: Use OptimizerNames.ADAMWTORCH with betas=(0.9,0.999) and epsilon=1e-08 and optimizerargs=No additional optimizer arguments
  • —lrschedulertype: linear
  • —num_epochs: 3

Training results

Training LossEpochStepValidation LossAccuracyPrecision BinaryRecall BinaryF1 BinaryPrecision MicroRecall MicroF1 MicroF1 MacroPr AucCohen Kappa
0.47061.05440.30990.89250.54720.23770.33140.89250.89250.89250.63650.85280.2827
0.32562.010880.45210.89980.62750.26230.36990.89980.89980.89980.65780.86600.3253
0.20733.016320.51050.89060.51690.37700.43600.89060.89060.89060.68770.86710.3771

Framework versions

  • —Transformers 4.52.2
  • —Pytorch 2.6.0+cu124
  • —Datasets 2.14.4
  • —Tokenizers 0.21.1