ikerHerrero/Basque_Dialects_Classification

1---2license: cc-by-nc-4.03tags:4- generated_from_trainer5metrics:6- f17model-index:8- name: Basque_Dialects_Classification9  results: []10widget:11- text: "Gaur eskolara etorri naiz"12  example_title: "Example 1"13- text: "Gaur eskolara etorri naz"14  example_title: "Example 2"15---16 17<!-- This model card has been generated automatically according to the information the Trainer had access to. You18should probably proofread and complete it, then remove this comment. -->19 20# Basque_Dialects_Classification21 22This model is a fine-tuned version of [ixa-ehu/roberta-eus-cc100-base-cased](https://huggingface.co/ixa-ehu/roberta-eus-cc100-base-cased) on the None dataset.23It achieves the following results on the evaluation set:24- Loss: 1.455825- F1: 0.684626 27## Model description28 29More information needed30 31## Intended uses & limitations32 33More information needed34 35## Training and evaluation data36 37More information needed38 39## Training procedure40 41### Training hyperparameters42 43The following hyperparameters were used during training:44- learning_rate: 7.2193610624691235e-0645- train_batch_size: 146- eval_batch_size: 847- seed: 4248- optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-0849- lr_scheduler_type: linear50- lr_scheduler_warmup_steps: 0.751- num_epochs: 552 53### Training results54 55| Training Loss | Epoch | Step  | Validation Loss | F1     |56|:-------------:|:-----:|:-----:|:---------------:|:------:|57| 1.4126        | 1.0   | 9611  | 1.4626          | 0.5893 |58| 1.3446        | 2.0   | 19222 | 1.5642          | 0.6421 |59| 1.0157        | 3.0   | 28833 | 1.5049          | 0.6596 |60| 1.3012        | 4.0   | 38444 | 1.4939          | 0.6708 |61| 1.0824        | 5.0   | 48055 | 1.4558          | 0.6846 |62 63 64### Framework versions65 66- Transformers 4.22.267- Pytorch 1.12.1+cu11368- Datasets 2.5.269- Tokenizers 0.12.170