sms112/euk_roberta_large_essentiality_Network

1---2library_name: transformers3license: mit4base_model: roberta-large5tags:6- generated_from_trainer7metrics:8- accuracy9- precision10- recall11- f112model-index:13- name: euk_roberta_large_essentiality_Network14  results: []15---16 17<!-- This model card has been generated automatically according to the information the Trainer had access to. You18should probably proofread and complete it, then remove this comment. -->19 20# euk_roberta_large_essentiality_Network21 22This model is a fine-tuned version of [roberta-large](https://huggingface.co/roberta-large) on an unknown dataset.23It achieves the following results on the evaluation set:24- Loss: 0.430725- Accuracy: 0.821026- Precision: 0.788627- Recall: 0.877128- F1: 0.830529 30## Model description31 32More information needed33 34## Intended uses & limitations35 36More information needed37 38## Training and evaluation data39 40More information needed41 42## Training procedure43 44### Training hyperparameters45 46The following hyperparameters were used during training:47- learning_rate: 1e-0548- train_batch_size: 6049- eval_batch_size: 6050- seed: 4251- gradient_accumulation_steps: 452- total_train_batch_size: 24053- optimizer: Use OptimizerNames.ADAMW_TORCH_FUSED with betas=(0.9,0.999) and epsilon=1e-08 and optimizer_args=No additional optimizer arguments54- lr_scheduler_type: linear55- num_epochs: 1556- mixed_precision_training: Native AMP57 58### Training results59 60| Training Loss | Epoch | Step | Validation Loss | Accuracy | Precision | Recall | F1     |61|:-------------:|:-----:|:----:|:---------------:|:--------:|:---------:|:------:|:------:|62| No log        | 1.0   | 47   | 0.5793          | 0.7023   | 0.7021    | 0.7031 | 0.7026 |63| No log        | 2.0   | 94   | 0.4761          | 0.7812   | 0.7861    | 0.7727 | 0.7794 |64| No log        | 3.0   | 141  | 0.4792          | 0.7769   | 0.7506    | 0.8295 | 0.7881 |65| No log        | 4.0   | 188  | 0.4617          | 0.7822   | 0.7641    | 0.8168 | 0.7896 |66| No log        | 5.0   | 235  | 0.4748          | 0.7769   | 0.7393    | 0.8558 | 0.7933 |67| No log        | 6.0   | 282  | 0.4401          | 0.7961   | 0.7773    | 0.8303 | 0.8029 |68| No log        | 7.0   | 329  | 0.4273          | 0.7968   | 0.7828    | 0.8217 | 0.8018 |69| No log        | 8.0   | 376  | 0.4282          | 0.8099   | 0.7825    | 0.8587 | 0.8188 |70| No log        | 9.0   | 423  | 0.4242          | 0.8099   | 0.8       | 0.8267 | 0.8131 |71| No log        | 10.0  | 470  | 0.4248          | 0.8089   | 0.7908    | 0.8402 | 0.8147 |72| 1.8645        | 11.0  | 517  | 0.4183          | 0.8139   | 0.8095    | 0.8210 | 0.8152 |73| 1.8645        | 12.0  | 564  | 0.4206          | 0.8195   | 0.7988    | 0.8544 | 0.8257 |74| 1.8645        | 13.0  | 611  | 0.4225          | 0.8178   | 0.7985    | 0.8501 | 0.8235 |75| 1.8645        | 14.0  | 658  | 0.4307          | 0.8210   | 0.7886    | 0.8771 | 0.8305 |76| 1.8645        | 15.0  | 705  | 0.4259          | 0.8163   | 0.8016    | 0.8409 | 0.8208 |77 78 79### Framework versions80 81- Transformers 5.0.082- Pytorch 2.9.0+cu12883- Datasets 4.0.084- Tokenizers 0.22.285