eternalGenius/rubert_level2

1---2library_name: transformers3base_model: eternalGenius/rubert_level24tags:5- generated_from_trainer6model-index:7- name: rubert_level28  results: []9---10 11<!-- This model card has been generated automatically according to the information the Trainer had access to. You12should probably proofread and complete it, then remove this comment. -->13 14# rubert_level215 16This model is a fine-tuned version of [eternalGenius/rubert_level2](https://huggingface.co/eternalGenius/rubert_level2) on the None dataset.17It achieves the following results on the evaluation set:18- Loss: 0.166119- F1 Micro: 0.717820- F1 Macro: 0.707621- F1 Weighted: 0.711822 23## Model description24 25More information needed26 27## Intended uses & limitations28 29More information needed30 31## Training and evaluation data32 33More information needed34 35## Training procedure36 37### Training hyperparameters38 39The following hyperparameters were used during training:40- learning_rate: 5e-0641- train_batch_size: 842- eval_batch_size: 843- seed: 4244- optimizer: Use OptimizerNames.ADAMW_TORCH_FUSED with betas=(0.9,0.999) and epsilon=1e-08 and optimizer_args=No additional optimizer arguments45- lr_scheduler_type: linear46- lr_scheduler_warmup_steps: 0.147- num_epochs: 1548- mixed_precision_training: Native AMP49 50### Training results51 52| Training Loss | Epoch | Step | Validation Loss | F1 Micro | F1 Macro | F1 Weighted |53|:-------------:|:-----:|:----:|:---------------:|:--------:|:--------:|:-----------:|54| 0.1082        | 1.0   | 97   | 0.1827          | 0.6862   | 0.6628   | 0.6653      |55| 0.0939        | 2.0   | 194  | 0.1743          | 0.7165   | 0.7000   | 0.7067      |56| 0.0861        | 3.0   | 291  | 0.1737          | 0.7198   | 0.7049   | 0.7055      |57| 0.0796        | 4.0   | 388  | 0.1735          | 0.7160   | 0.7074   | 0.7095      |58| 0.0771        | 5.0   | 485  | 0.1699          | 0.7089   | 0.6921   | 0.6923      |59| 0.0668        | 6.0   | 582  | 0.1661          | 0.7178   | 0.7076   | 0.7118      |60 61 62### Framework versions63 64- Transformers 5.0.065- Pytorch 2.10.0+cu12866- Datasets 4.0.067- Tokenizers 0.22.268