CoolFace
Modelpublic

hurtmongoose/bert-base-detect-jailbreak

sourceHugging Faceapache-2.0updated 10mo agoView on Hugging Face
0likes75downloads
Model Card

<!-- This model card has been generated automatically according to the information the Trainer had access to. You should probably proofread and complete it, then remove this comment. -->

bert-base-detect-jailbreak

This model is a fine-tuned version of bert-base-uncased on an unknown dataset. It achieves the following results on the evaluation set:

  • Loss: 0.3486
  • Accuracy: 0.8931
  • Precision: 0.9206
  • Recall: 0.8657
  • F1: 0.8923
  • Balanced Accuracy: 0.8938
  • Mcc: 0.7879

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

  • learning_rate: 2e-05
  • trainbatchsize: 32
  • evalbatchsize: 64
  • seed: 42
  • optimizer: Use adamwtorch with betas=(0.9,0.999) and epsilon=1e-08 and optimizerargs=No additional optimizer arguments
  • lrschedulertype: linear
  • num_epochs: 10

Training results

Training LossEpochStepValidation LossAccuracyPrecisionRecallF1Balanced AccuracyMcc
No log1.0990.27300.90590.93050.87880.90390.90610.8130
0.45322.01980.26100.90590.95480.85350.90130.90630.8165
0.26833.02970.26220.90080.94410.85350.89660.90110.8054
0.2024.03960.29140.91090.91790.90400.91090.91100.8220
0.13085.04950.30120.91350.93620.88890.91190.91370.8281
0.08566.05940.37090.89060.88180.90400.89280.89050.7814
0.06227.06930.41410.89570.89050.90400.89720.89560.7914
0.03668.07920.47110.89570.87200.92930.89980.89540.7930
0.02629.08910.43180.89820.89900.89900.89900.89820.7964
0.014510.09900.44400.89570.88670.90910.89780.89560.7916

Framework versions

  • Transformers 4.53.3
  • Pytorch 2.6.0+cu124
  • Datasets 4.3.0
  • Tokenizers 0.21.4