CoolFace
Modelpublic

Marc-Hagenbusch/vit-base-caltech-ucsd-birds-200-2011

sourceHugging Faceapache-2.0updated 1y agoView on Hugging Face
0likes9downloads
Model Card

<!-- This model card has been generated automatically according to the information the Trainer had access to. You should probably proofread and complete it, then remove this comment. -->

vit-base-caltech-ucsd-birds-200-2011

This model is a fine-tuned version of google/vit-base-patch16-224 on the bentrevett/caltech-ucsd-birds-200-2011 dataset. It achieves the following results on the evaluation set:

  • —Loss: 1.0943
  • —Accuracy: 0.7608

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

  • —learning_rate: 5e-05
  • —trainbatchsize: 16
  • —evalbatchsize: 8
  • —seed: 42
  • —optimizer: Use OptimizerNames.ADAMWTORCH with betas=(0.9,0.999) and epsilon=1e-08 and optimizerargs=No additional optimizer arguments
  • —lrschedulertype: linear
  • —lrschedulerwarmup_ratio: 0.1
  • —num_epochs: 15

Training results

Training LossEpochStepValidation LossAccuracy
5.00591.05904.73090.1094
3.55282.011803.21570.5199
2.32843.017702.22540.6455
1.75614.023601.72770.6819
1.52425.029501.51940.6955
1.27696.035401.32850.7396
1.18137.041301.30440.7193
1.0978.047201.18780.7506
1.13069.053101.11450.7566
0.998810.059001.08680.7506
0.988711.064901.07600.7659
0.982612.070801.08490.7634
0.961213.076701.06590.7642
0.967914.082601.09390.7455
1.024215.088501.09410.7472

Framework versions

  • —Transformers 4.52.4
  • —Pytorch 2.7.0
  • —Datasets 3.6.0
  • —Tokenizers 0.21.1