ShantanuT01/dactyl-tinybert-finetuned

1---2library_name: transformers3tags: []4---5# DACTYL Text Detector6## Training Configuration7```json8{9    "training_split": "training",10    "evaluation_split": "testing",11    "results_path": "libauc-tinybert.csv",12    "num_epochs": 1,13    "model_path": "ShantanuT01/dactyl-tinybert-pretrained",14    "tokenizer": "huawei-noah/TinyBERT_General_4L_312D",15    "optimizer": "SOTAs",16    "optimizer_type": "libauc",17    "optimizer_args": {18        "lr": 1e-0519    },20    "loss_fn": "tpAUC_KL_Loss",21    "reset_classification_head": true,22    "loss_type": "libauc",23    "loss_fn_args": {24        "data_len": 46600525    },26    "needs_loss_fn_as_parameter": false,27    "save_path": "ShantanuT01/dactyl-tinybert-finetuned",28    "training_args": {29        "batch_size": 64,30        "needs_sampler": true,31        "needs_index": true,32        "shuffle": false,33        "sampling_rate": 0.5,34        "apply_sigmoid": true35    },36    "best_model_path": "best-tpauc-model-tinybert"37}38```39## Results40| model                                                                                 |   AP Score |   AUC Score |   OPAUC Score |   TPAUC Score |41|:--------------------------------------------------------------------------------------|-----------:|------------:|--------------:|--------------:|42| DeepSeek-V3                                                                           |  0.981321  |    0.996726 |      0.991002 |     0.921253  |43| ShantanuT01/fine-tuned-Llama-3.2-1B-Instruct-apollo-mini-RedditWritingPrompts-testing |  0.0340303 |    0.703731 |      0.647861 |     0         |44| ShantanuT01/fine-tuned-Llama-3.2-1B-Instruct-apollo-mini-abstracts-testing            |  0.184745  |    0.86911  |      0.683087 |     0         |45| ShantanuT01/fine-tuned-Llama-3.2-1B-Instruct-apollo-mini-news-testing                 |  0.0173351 |    0.615211 |      0.57306  |     0         |46| ShantanuT01/fine-tuned-Llama-3.2-1B-Instruct-apollo-mini-reviews-testing              |  0.108149  |    0.940023 |      0.769001 |     0         |47| ShantanuT01/fine-tuned-Llama-3.2-1B-Instruct-apollo-mini-student_essays-testing       |  0.0123406 |    0.58479  |      0.537483 |     0         |48| ShantanuT01/fine-tuned-Llama-3.2-1B-Instruct-apollo-mini-tweets-testing               |  0.311729  |    0.964433 |      0.818375 |     0.0128094 |49| claude-3-5-haiku-20241022                                                             |  0.961089  |    0.993304 |      0.977485 |     0.791218  |50| claude-3-5-sonnet-20241022                                                            |  0.978917  |    0.997052 |      0.989079 |     0.903623  |51| gemini-1.5-flash                                                                      |  0.945428  |    0.991914 |      0.967267 |     0.69349   |52| gemini-1.5-pro                                                                        |  0.887585  |    0.975313 |      0.931469 |     0.36524   |53| gpt-4o-2024-11-20                                                                     |  0.956721  |    0.992097 |      0.974751 |     0.764793  |54| gpt-4o-mini                                                                           |  0.986874  |    0.999249 |      0.995276 |     0.963878  |55| llama-3.2-90b                                                                         |  0.913169  |    0.982064 |      0.947501 |     0.505202  |56| llama-3.3-70b                                                                         |  0.957947  |    0.99155  |      0.97557  |     0.773428  |57| mistral-large-latest                                                                  |  0.980996  |    0.997519 |      0.99041  |     0.915818  |58| mistral-small-latest                                                                  |  0.9803    |    0.996372 |      0.990539 |     0.918353  |59| overall                                                                               |  0.975576  |    0.977332 |      0.951238 |     0.537319  |60