CoolFace
Modelpublic

swadhindas324/vit-resnet-mistral-RSICD-with-4-tag-supressed-captioning

sourceHugging Faceupdated 3mo agoView on Hugging Face
0likes4downloads
Model Card

<!-- This model card has been generated automatically according to the information the Trainer had access to. You should probably proofread and complete it, then remove this comment. -->

vit-resnet-mistral-RSICD-with-4-tag-supressed-captioning

This model is a fine-tuned version of [](https://huggingface.co/) on an unknown dataset. It achieves the following results on the evaluation set:

  • —Loss: 0.8448
  • —Accuracy: 81.3
  • —Bleu-1: 0.5812
  • —Bleu-2: 0.4428
  • —Bleu-3: 0.3523
  • —Bleu-4: 0.2891
  • —Meteor: 0.5291
  • —Rouge-l: 0.4997
  • —Cider: 1.5685

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

  • —learning_rate: 0.0001
  • —trainbatchsize: 64
  • —evalbatchsize: 64
  • —seed: 50
  • —optimizer: Use OptimizerNames.ADAMWTORCHFUSED with betas=(0.9,0.999) and epsilon=1e-08 and optimizer_args=No additional optimizer arguments
  • —lrschedulertype: linear
  • —lrschedulerwarmup_steps: 0.1
  • —num_epochs: 128
  • —mixedprecisiontraining: Native AMP

Training results

Training LossEpochStepValidation LossAccuracyBleu-1Bleu-2Bleu-3Bleu-4MeteorRouge-lCider
No log1.07680.689279.290.46680.30270.21150.15370.40850.39750.4800
0.96252.015360.664980.070.53960.38140.28270.21650.50740.46800.8449
0.47103.023040.624281.20.70620.58480.49050.41480.69120.64102.2522
0.35094.030720.669581.740.68390.56210.47390.40510.66610.62752.2498
0.35095.038400.738680.490.63010.50150.40890.34110.62020.56891.8344
0.24086.046080.769082.180.66110.53090.43740.36760.61070.58051.9653
0.18977.053760.817381.940.63660.50980.41860.35120.61130.56671.8479
0.16638.061440.844881.30.58120.44280.35230.28910.52910.49971.5685

Framework versions

  • —Transformers 5.12.1
  • —Pytorch 2.12.1+cu130
  • —Datasets 5.0.0
  • —Tokenizers 0.22.2