CoolFace
Modelpublic

swadhindas324/vit-resnet-mistral-RSICD-with-all-captioning

sourceHugging Faceupdated 3mo agoView on Hugging Face
0likes7downloads
Model Card

<!-- This model card has been generated automatically according to the information the Trainer had access to. You should probably proofread and complete it, then remove this comment. -->

vit-resnet-mistral-RSICD-with-all-captioning

This model is a fine-tuned version of [](https://huggingface.co/) on an unknown dataset. It achieves the following results on the evaluation set:

  • —Loss: 0.9445
  • —Accuracy: 83.3
  • —Bleu-1: 0.7176
  • —Bleu-2: 0.5943
  • —Bleu-3: 0.4976
  • —Bleu-4: 0.4213
  • —Meteor: 0.6975
  • —Rouge-l: 0.6536
  • —Cider: 2.3170

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

  • —learning_rate: 0.0001
  • —trainbatchsize: 64
  • —evalbatchsize: 64
  • —seed: 50
  • —optimizer: Use OptimizerNames.ADAMWTORCHFUSED with betas=(0.9,0.999) and epsilon=1e-08 and optimizer_args=No additional optimizer arguments
  • —lrschedulertype: linear
  • —lrschedulerwarmup_steps: 0.1
  • —num_epochs: 128
  • —mixedprecisiontraining: Native AMP

Training results

Training LossEpochStepValidation LossAccuracyBleu-1Bleu-2Bleu-3Bleu-4MeteorRouge-lCider
No log1.07680.691880.440.46680.30270.21150.15370.40850.39750.4800
0.96422.015360.663580.290.54080.38740.29190.22650.50580.47660.8519
0.47373.023040.621483.140.74460.63010.54020.46510.65660.65372.3764
0.34864.030720.658984.130.73780.61980.53310.46520.63580.64152.3975
0.34865.038400.724683.40.73840.61970.52680.45340.64800.63682.3862
0.24616.046080.762784.110.74080.62090.52840.45520.65250.64142.4117
0.19637.053760.811883.840.74240.62420.53290.45880.68460.65902.4723
0.17268.061440.822884.390.73900.61570.52080.44630.66640.64402.4668
0.17269.069120.881884.410.74390.62790.53560.46180.67590.65302.4460
0.153110.076800.862884.250.74470.62290.53030.45670.67260.65162.4548
0.147711.084480.904383.920.73660.62080.53050.45940.69590.65852.5263
0.145212.092160.944583.30.71760.59430.49760.42130.69750.65362.3170

Framework versions

  • —Transformers 5.12.1
  • —Pytorch 2.12.1+cu130
  • —Datasets 5.0.0
  • —Tokenizers 0.22.2