CesarLeblanc/geoplantbert_text_classification_model

1---2tags:3- generated_from_trainer4metrics:5- accuracy6model-index:7- name: geoplantbert_text_classification_model8  results: []9---10 11<!-- This model card has been generated automatically according to the information the Trainer had access to. You12should probably proofread and complete it, then remove this comment. -->13 14# geoplantbert_text_classification_model15 16This model was trained from scratch on an unknown dataset.17It achieves the following results on the evaluation set:18- Loss: 4.224919- Accuracy: 0.094820 21## Model description22 23More information needed24 25## Intended uses & limitations26 27More information needed28 29## Training and evaluation data30 31More information needed32 33## Training procedure34 35### Training hyperparameters36 37The following hyperparameters were used during training:38- learning_rate: 5e-0539- train_batch_size: 440- eval_batch_size: 441- seed: 12342- optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-0843- lr_scheduler_type: linear44- num_epochs: 545- mixed_precision_training: Native AMP46 47### Training results48 49| Training Loss | Epoch | Step   | Validation Loss | Accuracy |50|:-------------:|:-----:|:------:|:---------------:|:--------:|51| 4.1776        | 1.0   | 68400  | 4.2204          | 0.0948   |52| 4.2058        | 2.0   | 136800 | 4.2118          | 0.0948   |53| 4.1949        | 3.0   | 205200 | 4.2219          | 0.0948   |54| 4.1297        | 4.0   | 273600 | 4.2298          | 0.0948   |55| 4.2056        | 5.0   | 342000 | 4.2249          | 0.0948   |56 57 58### Framework versions59 60- Transformers 4.35.261- Pytorch 2.1.1+cu12162- Datasets 2.15.063- Tokenizers 0.15.064