Mantis-VL/mllava_v2_4096

1---2base_model: llava-hf/llava-1.5-7b-hf3tags:4- generated_from_trainer5model-index:6- name: mllava_v2_40967  results: []8---9 10<!-- This model card has been generated automatically according to the information the Trainer had access to. You11should probably proofread and complete it, then remove this comment. -->12 13# mllava_v2_409614 15This model is a fine-tuned version of [llava-hf/llava-1.5-7b-hf](https://huggingface.co/llava-hf/llava-1.5-7b-hf) on an unknown dataset.16 17## Model description18 19More information needed20 21## Intended uses & limitations22 23More information needed24 25## Training and evaluation data26 27More information needed28 29## Training procedure30 31### Training hyperparameters32 33The following hyperparameters were used during training:34- learning_rate: 1e-0535- train_batch_size: 136- eval_batch_size: 137- seed: 4238- distributed_type: multi-GPU39- num_devices: 1640- gradient_accumulation_steps: 441- total_train_batch_size: 6442- total_eval_batch_size: 1643- optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-0844- lr_scheduler_type: cosine45- lr_scheduler_warmup_ratio: 0.0346- num_epochs: 3.047 48### Training results49 50 51 52### Framework versions53 54- Transformers 4.37.055- Pytorch 2.2.156- Datasets 2.17.157- Tokenizers 0.15.258