CoolFace
Modelpublic

pcam-interpretability/dino-vits16-val07415-vit-tuned

sourceHugging Faceupdated 1y agoView on Hugging Face
0likes
Model Card

dino-vits16

Best Validation Accuracy: 0.7415

Metadata

  • —Model Name: dino-vits16
  • —Optimizer: adamw
  • —Scheduler: cosine
  • —Weight Decay: 0.001
  • —Warmup Epochs: 3
  • —Patience: 10
  • —Amp: True
  • —Seed: 42
  • —Batch Size: 352
  • —Initial Lr: 0.0012
  • —Total Epochs Ran: 12
  • —Early Stopped: True
  • —Training Time Seconds: 7287.24094581604
  • —Num Parameters: 21666049
  • —Device: NVIDIA A100-SXM4-40GB
  • —Run Id: vit-tuned

Training Configuration

  • —Epochs: 12
  • —Batch size: 352
  • —Learning rate (initial): 0.0012

Training Logs (Per Epoch)

EpochTrain LossTrain AccVal LossVal AccLR
10.66630.67820.52340.73090.000400
20.52460.73830.50540.74150.000800
3nan0.71730.63980.66990.001200
4nan0.5349nan0.50050.001200
5nan0.5000nan0.50050.001199
6nan0.5000nan0.50050.001195
7nan0.5000nan0.50050.001189
8nan0.5000nan0.50050.001181
9nan0.5000nan0.50050.001171
10nan0.5000nan0.50050.001158
11nan0.5000nan0.50050.001143
12nan0.5000nan0.50050.001126