codingrev/89-learning-hub-model

1---2library_name: transformers3license: other4base_model: Qwen/Qwen2-VL-7B-Instruct5tags:6- llama-factory7- full8- generated_from_trainer9model-index:10- name: sft11  results: []12---13 14<!-- This model card has been generated automatically according to the information the Trainer had access to. You15should probably proofread and complete it, then remove this comment. -->16 17# sft18 19This model is a fine-tuned version of [Qwen/Qwen2-VL-7B-Instruct](https://huggingface.co/Qwen/Qwen2-VL-7B-Instruct) on the medical_text dataset.20 21## Model description22 23More information needed24 25## Intended uses & limitations26 27More information needed28 29## Training and evaluation data30 31More information needed32 33## Training procedure34 35### Training hyperparameters36 37The following hyperparameters were used during training:38- learning_rate: 1e-0539- train_batch_size: 140- eval_batch_size: 841- seed: 4242- distributed_type: multi-GPU43- num_devices: 444- gradient_accumulation_steps: 245- total_train_batch_size: 846- total_eval_batch_size: 3247- optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-0848- lr_scheduler_type: cosine49- lr_scheduler_warmup_ratio: 0.150- num_epochs: 5.051 52### Training results53 54 55 56### Framework versions57 58- Transformers 4.45.259- Pytorch 2.5.0+cu12460- Datasets 2.21.061- Tokenizers 0.20.162