CoolFace
Modelpublic

ajrayman/Altruism_binary

sourceHugging Facemitupdated 21d agoView on Hugging Face
0likes147downloads
README.md74 linesDownload Raw Back to root
1---2library_name: transformers3license: mit4base_model: microsoft/deberta-v3-base5tags:6- generated_from_trainer7metrics:8- accuracy9- precision10- recall11- f112model-index:13- name: Altruism_binary14  results: []15---16 17<!-- This model card has been generated automatically according to the information the Trainer had access to. You18should probably proofread and complete it, then remove this comment. -->19 20# Altruism_binary21 22This model is a fine-tuned version of [microsoft/deberta-v3-base](https://huggingface.co/microsoft/deberta-v3-base) on the None dataset.23It achieves the following results on the evaluation set:24- Loss: 0.720225- Accuracy: 0.698626- Precision: 0.661327- Recall: 0.813028- F1: 0.729329- Auc: 0.780630 31## Model description32 33More information needed34 35## Intended uses & limitations36 37More information needed38 39## Training and evaluation data40 41More information needed42 43## Training procedure44 45### Training hyperparameters46 47The following hyperparameters were used during training:48- learning_rate: 2e-0549- train_batch_size: 3250- eval_batch_size: 3251- seed: 123452- optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-0853- lr_scheduler_type: linear54- lr_scheduler_warmup_ratio: 0.0655- num_epochs: 856 57### Training results58 59| Training Loss | Epoch | Step | Validation Loss | Accuracy | Precision | Recall | F1     | Auc    |60|:-------------:|:-----:|:----:|:---------------:|:--------:|:---------:|:------:|:------:|:------:|61| No log        | 1.0   | 118  | 0.6034          | 0.6650   | 0.61      | 0.9127 | 0.7313 | 0.7688 |62| No log        | 2.0   | 236  | 0.5704          | 0.7173   | 0.6843    | 0.8055 | 0.7400 | 0.7867 |63| No log        | 3.0   | 354  | 0.5799          | 0.7073   | 0.6566    | 0.8678 | 0.7476 | 0.7832 |64| No log        | 4.0   | 472  | 0.6729          | 0.6725   | 0.6194    | 0.8928 | 0.7314 | 0.7767 |65| 0.5183        | 5.0   | 590  | 0.7202          | 0.6986   | 0.6613    | 0.8130 | 0.7293 | 0.7806 |66 67 68### Framework versions69 70- Transformers 4.44.171- Pytorch 1.11.072- Datasets 2.12.073- Tokenizers 0.19.174