CoolFace
Modelpublic

ShantanuT01/dactyl-bert-tiny-finetuned

sourceHugging Faceupdated 1y agoView on Hugging Face
0likes21downloads
Model Card

DACTYL Text Detector

Training Configuration

json
{
    "training_split": "training",
    "evaluation_split": "testing",
    "results_path": "libauc-bert-tiny.csv",
    "num_epochs": 1,
    "model_path": "ShantanuT01/dactyl-bert-tiny-pretrained",
    "tokenizer": "prajjwal1/bert-tiny",
    "optimizer": "SOTAs",
    "optimizer_type": "libauc",
    "optimizer_args": {
        "lr": 1e-05
    },
    "loss_fn": "tpAUC_KL_Loss",
    "reset_classification_head": true,
    "loss_type": "libauc",
    "loss_fn_args": {
        "data_len": 466005
    },
    "needs_loss_fn_as_parameter": false,
    "save_path": "ShantanuT01/dactyl-bert-tiny-finetuned",
    "training_args": {
        "batch_size": 64,
        "needs_sampler": true,
        "needs_index": true,
        "shuffle": false,
        "sampling_rate": 0.5,
        "apply_sigmoid": true
    },
    "best_model_path": "best-tpauc-model-bert-tiny"
}

Results

modelAP ScoreAUC ScoreOPAUC ScoreTPAUC Score
DeepSeek-V30.9861770.9973570.9914220.916469
ShantanuT01/fine-tuned-Llama-3.2-1B-Instruct-apollo-mini-RedditWritingPrompts-testing0.02422640.8057380.6197150
ShantanuT01/fine-tuned-Llama-3.2-1B-Instruct-apollo-mini-abstracts-testing0.4731220.9558280.8577740.0525074
ShantanuT01/fine-tuned-Llama-3.2-1B-Instruct-apollo-mini-news-testing0.02239950.7763010.5790920
ShantanuT01/fine-tuned-Llama-3.2-1B-Instruct-apollo-mini-reviews-testing0.01674090.8614970.5263590
ShantanuT01/fine-tuned-Llama-3.2-1B-Instruct-apollo-mini-student_essays-testing0.01023120.6216290.518840
ShantanuT01/fine-tuned-Llama-3.2-1B-Instruct-apollo-mini-tweets-testing0.2001690.9491630.7281220
claude-3-5-haiku-202410220.964850.9937690.9774450.780686
claude-3-5-sonnet-202410220.9811210.9972360.9879990.883237
gemini-1.5-flash0.933740.9898880.9556990.57296
gemini-1.5-pro0.8565750.969670.9096630.190672
gpt-4o-2024-11-200.9500620.9900510.9685280.695722
gpt-4o-mini0.9926340.9991490.9952250.953515
llama-3.2-90b0.8955710.9782010.9332290.366601
llama-3.3-70b0.9524390.9922520.9689290.699379
mistral-large-latest0.9793450.9969370.9867580.871375
mistral-small-latest0.9868360.9974990.9913050.915284
overall0.9767840.9807590.9473710.492028