CoolFace
Modelpublic

ShantanuT01/dactyl-deberta-v3-large-pretrained

sourceHugging Faceupdated 1y agoView on Hugging Face
0likes7downloads
Model Card

DACTYL Text Detector

Training Configuration

json
{
        "training_split": "training",
        "evaluation_split": "testing",
        "results_path":"bce-debertav3-large.csv",
        "num_epochs": 1,
        "model_path": "best-debertav3-model",
        "tokenizer": "microsoft/deberta-v3-large",
        "optimizer": "AdamW",
        "optimizer_type": "torch",
        "optimizer_args": {
            "lr": 2e-5,
            "weight_decay":0.01
        },
        "loss_fn": "BCEWithLogitsLoss",
        "reset_classification_head": false,
        "loss_type": "torch",
        "loss_fn_args": {},
        "needs_loss_fn_as_parameter": false,
        "save_path": "ShantanuT01/dactyl-deberta-v3-large-pretrained",
        "training_args": {
            "batch_size": 16,
            "needs_sampler": false,
            "needs_index": false,
            "shuffle": true,
            "sampling_rate": null,
            "apply_sigmoid": false
        },
        "best_model_path": "best-debertav3-model",
        "eval_batch_size": 8
    
}

Results

modelAP ScoreAUC ScoreOPAUC ScoreTPAUC Score
DeepSeek-V30.9960180.9998270.9982680.98686
ShantanuT01/fine-tuned-Llama-3.2-1B-Instruct-apollo-mini-RedditWritingPrompts-testing0.705320.9596440.9101330.160828
ShantanuT01/fine-tuned-Llama-3.2-1B-Instruct-apollo-mini-abstracts-testing0.7244590.9802790.9277570.411551
ShantanuT01/fine-tuned-Llama-3.2-1B-Instruct-apollo-mini-news-testing0.420230.9342120.8409510
ShantanuT01/fine-tuned-Llama-3.2-1B-Instruct-apollo-mini-reviews-testing0.3203660.9537430.8349187.85083e-05
ShantanuT01/fine-tuned-Llama-3.2-1B-Instruct-apollo-mini-student_essays-testing0.01520290.792270.5103760
ShantanuT01/fine-tuned-Llama-3.2-1B-Instruct-apollo-mini-tweets-testing0.4686150.9757520.8561270.0610184
claude-3-5-haiku-202410220.9725410.9969020.9823380.834824
claude-3-5-sonnet-202410220.9921470.9995090.9959120.964305
gemini-1.5-flash0.9626760.9953950.9771430.784304
gemini-1.5-pro0.9192760.9846040.9498690.528626
gpt-4o-2024-11-200.9738550.9969130.9838870.84817
gpt-4o-mini0.9942240.9997810.9980070.987244
llama-3.2-90b0.9386080.989160.9608720.62814
llama-3.3-70b0.9777130.9975080.9860660.869837
mistral-large-latest0.9923860.9995510.996280.968953
mistral-small-latest0.9937470.9995560.9971510.977661
overall0.9892940.9918590.9716240.730174