CoolFace
Modelpublic

swadhindas324/vit-convnext-mistral-RSICD-with-8-captioning

sourceHugging Faceupdated 3mo agoView on Hugging Face
0likes4downloads
Model Card

<!-- This model card has been generated automatically according to the information the Trainer had access to. You should probably proofread and complete it, then remove this comment. -->

vit-convnext-mistral-RSICD-with-8-captioning

This model is a fine-tuned version of [](https://huggingface.co/) on an unknown dataset. It achieves the following results on the evaluation set:

  • —Loss: 0.8669
  • —Accuracy: 84.07
  • —Bleu-1: 0.7351
  • —Bleu-2: 0.6142
  • —Bleu-3: 0.5215
  • —Bleu-4: 0.4484
  • —Meteor: 0.6824
  • —Rouge-l: 0.6570
  • —Cider: 2.4471

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

  • —learning_rate: 0.0001
  • —trainbatchsize: 64
  • —evalbatchsize: 64
  • —seed: 50
  • —optimizer: Use OptimizerNames.ADAMWTORCHFUSED with betas=(0.9,0.999) and epsilon=1e-08 and optimizer_args=No additional optimizer arguments
  • —lrschedulertype: linear
  • —lrschedulerwarmup_steps: 0.1
  • —num_epochs: 128
  • —mixedprecisiontraining: Native AMP

Training results

Training LossEpochStepValidation LossAccuracyBleu-1Bleu-2Bleu-3Bleu-4MeteorRouge-lCider
No log1.07680.691280.570.46680.30270.21150.15370.40850.39750.4800
0.96132.015360.666379.370.54640.38870.28870.22000.51300.47340.8232
0.47793.023040.623281.880.72140.59890.50460.42830.69260.65352.3241
0.36134.030720.663383.510.74020.62410.53620.46590.68660.65802.4857
0.36135.038400.713183.310.74630.63020.54040.46950.67980.66072.5527
0.25246.046080.758583.960.73720.61960.53130.46140.67650.65452.5128
0.19827.053760.815483.360.71960.60210.51080.43720.69610.65352.4308
0.17308.061440.818783.590.71680.59510.50180.42980.68270.64242.3597
0.17309.069120.853383.890.73350.61270.52160.44870.67750.65312.4155
0.153210.076800.866984.070.73510.61420.52150.44840.68240.65702.4471

Framework versions

  • —Transformers 5.12.1
  • —Pytorch 2.12.1+cu130
  • —Datasets 5.0.0
  • —Tokenizers 0.22.2