oranne55/qualifier-model3-finetune-pretrained-transformer

Jailbreak Classifier

Classifies prompts as jailbreaks or benign. This is a fine-tune checkpoint of bert-base-uncased on the jailbreak-classification dataset.

Training Details

Training Data

Fine-tuned on the jailbreak-classification dataset.

Training Procedure

Training Hyperparameters

Second fine-tuning hyper-parameters(on train(0.8) and val(0.2))

• —learning_rate = 5e-5
• —trainbatchsize = 8
• —evalbatchsize = 8
• —lrschedulertype = linear
• —numtrainepochs = 5.0

Fecond fine-tuning hyper-parameters(on train and test)

• —learning_rate = 1e-5
• —trainbatchsize = 8
• —evalbatchsize = 8
• —lrschedulertype = linear
• —numtrainepochs = 3.0