eatlas/testing_model

1---2license: apache-2.03base_model: google-t5/t5-small4tags:5- generated_from_trainer6metrics:7- rouge8model-index:9- name: testing_model10  results: []11---12 13<!-- This model card has been generated automatically according to the information the Trainer had access to. You14should probably proofread and complete it, then remove this comment. -->15 16# testing_model17 18This model is a fine-tuned version of [google-t5/t5-small](https://huggingface.co/google-t5/t5-small) on the None dataset.19It achieves the following results on the evaluation set:20- Loss: 3.872821- Rouge1: 0.13222- Rouge2: 0.070723- Rougel: 0.13224- Rougelsum: 0.13225- Gen Len: 19.026 27## Model description28 29More information needed30 31## Intended uses & limitations32 33More information needed34 35## Training and evaluation data36 37More information needed38 39## Training procedure40 41### Training hyperparameters42 43The following hyperparameters were used during training:44- learning_rate: 2e-0545- train_batch_size: 1646- eval_batch_size: 1647- seed: 4248- optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-0849- lr_scheduler_type: linear50- num_epochs: 451- mixed_precision_training: Native AMP52 53### Training results54 55| Training Loss | Epoch | Step | Validation Loss | Rouge1 | Rouge2 | Rougel | Rougelsum | Gen Len |56|:-------------:|:-----:|:----:|:---------------:|:------:|:------:|:------:|:---------:|:-------:|57| No log        | 1.0   | 1    | 4.0915          | 0.132  | 0.0707 | 0.132  | 0.132     | 19.0    |58| No log        | 2.0   | 2    | 3.9720          | 0.132  | 0.0707 | 0.132  | 0.132     | 19.0    |59| No log        | 3.0   | 3    | 3.9056          | 0.132  | 0.0707 | 0.132  | 0.132     | 19.0    |60| No log        | 4.0   | 4    | 3.8728          | 0.132  | 0.0707 | 0.132  | 0.132     | 19.0    |61 62 63### Framework versions64 65- Transformers 4.38.266- Pytorch 2.2.1+cu12167- Datasets 2.18.068- Tokenizers 0.15.269