SednaWorld/transfer-learning

1---2license: apache-2.03tags:4- generated_from_trainer5metrics:6- accuracy7- f18model-index:9- name: transfer-learning10  results: []11---12 13<!-- This model card has been generated automatically according to the information the Trainer had access to. You14should probably proofread and complete it, then remove this comment. -->15 16# transfer-learning17 18This model is a fine-tuned version of [distilroberta-base](https://huggingface.co/distilroberta-base) on an unknown dataset.19It achieves the following results on the evaluation set:20- Loss: 0.718221- Accuracy: 0.806422- F1: 0.846023 24## Model description25 26More information needed27 28## Intended uses & limitations29 30More information needed31 32## Training and evaluation data33 34More information needed35 36## Training procedure37 38### Training hyperparameters39 40The following hyperparameters were used during training:41- learning_rate: 5e-0542- train_batch_size: 843- eval_batch_size: 844- seed: 4245- optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-0846- lr_scheduler_type: linear47- num_epochs: 348 49### Training results50 51| Training Loss | Epoch | Step | Validation Loss | Accuracy | F1     |52|:-------------:|:-----:|:----:|:---------------:|:--------:|:------:|53| 0.5176        | 1.09  | 500  | 0.7127          | 0.8015   | 0.8541 |54| 0.3704        | 2.18  | 1000 | 0.7182          | 0.8064   | 0.8460 |55 56 57### Framework versions58 59- Transformers 4.30.260- Pytorch 2.3.0+cu12161- Datasets 2.19.162- Tokenizers 0.13.363