dendimaki/multilabel_classification_v2

1---2license: apache-2.03library_name: peft4tags:5- generated_from_trainer6base_model: mistralai/Mistral-7B-v0.17model-index:8- name: multilabel_classification9  results: []10---11 12<!-- This model card has been generated automatically according to the information the Trainer had access to. You13should probably proofread and complete it, then remove this comment. -->14 15# multilabel_classification16 17This model is a fine-tuned version of [mistralai/Mistral-7B-v0.1](https://huggingface.co/mistralai/Mistral-7B-v0.1) on the None dataset.18 19## Model description20 21More information needed22 23## Intended uses & limitations24 25More information needed26 27## Training and evaluation data28 29More information needed30 31## Training procedure32 33### Training hyperparameters34 35The following hyperparameters were used during training:36- learning_rate: 0.000137- train_batch_size: 838- eval_batch_size: 839- seed: 4240- optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-0841- lr_scheduler_type: linear42- num_epochs: 143 44### Training results45 46| Training Loss | Epoch | Step | Validation Loss | F1 Micro | F1 Macro | F1 Weighted |47|:-------------:|:-----:|:----:|:---------------:|:--------:|:--------:|:-----------:|48| No log        | 1.0   | 478  | 0.0906          | 0.3919   | 0.1371   | 0.3467      |49 50 51### Framework versions52 53- PEFT 0.10.054- Transformers 4.40.055- Pytorch 2.2.1+cu12156- Datasets 2.19.057- Tokenizers 0.19.1