CoolFace
Modelpublic

yonad2008/predict_gnn_phi4_14b

sourceHugging Faceupdated 5mo agoView on Hugging Face
0likes
Model Card

GNN Jailbreak Prediction Model (phi4:14b)

Homogeneous GNN classifier for unsafe/jailbreak likelihood in multi-turn conversations.

Evaluation Results

MetricValue
F10.9411
PR-AUC0.9782
ROC-AUC0.9593
Precision0.9682
Recall0.9163
Best Threshold0.270

Training Details

  • Target model: phi4:14b
  • Datasets: harmbench, harmfulbehaviors1
  • Split column: goal
  • Seed: 42
  • Sentence model: sentence-transformers/all-MiniLM-L6-v2
  • Hidden channels: 128
  • Num layers: 2
  • Dropout: 0.3

Dataset Size (training samples)

Prepared turn-level samples: 707