CoolFace
Datasetpublic

Shanmuk4622/E2AM_MobileViTv2

E2AM Ablation Results: MobileViTv2 Energy-aware training ablation study for MobileViTv2 across three image-classification datasets: CIFAR-10, CIFAR-100, and Tiny-ImageNet. Each dataset has 15 training variants (8 individual-method M0..M7, 7 cumulative ablation C0..C6) at 50 epochs, plus a 5-variant deployment pipeline (FP32 baseline, structured pruning, pruning+finetune, INT8 quantization, pruned+INT8). Status: 45 completed variants, 0 partial. Quick links… See the full description on the dataset page: https://huggingface.co/datasets/Shanmuk4622/E2AM_MobileViTv2.

sourceHugging Faceapache-2.0updated 4mo agoView on Hugging Face
0likes146downloads
Dataset Card

E2AM Ablation Results: MobileViTv2

Energy-aware training ablation study for MobileViTv2 across three image-classification datasets: CIFAR-10, CIFAR-100, and Tiny-ImageNet.

Each dataset has 15 training variants (8 individual-method M0..M7, 7 cumulative ablation C0..C6) at 50 epochs, plus a 5-variant deployment pipeline (FP32 baseline, structured pruning, pruning+finetune, INT8 quantization, pruned+INT8).

Status: 45 completed variants, 0 partial.

Quick links

Headline results

DatasetBest variantTop-1Top-5Energy (kWh)CO₂ (kg)Time (sec)
CIFAR-10C6fulle2am0.92980.99800.25350.120412086
CIFAR-100M7fulle2am0.73070.92690.27570.131013298
Tiny-ImageNetC5cacheampgradaccumadaptivelr_l10.58570.81200.52050.247224838

Cross-dataset comparison

How the same training variants behave across CIFAR-10, CIFAR-100, and Tiny-ImageNet.

Accuracy By Variant Across Datasets

[image]

Energy By Variant Across Datasets

[image]

Per-dataset results

CIFAR-10

M-matrix (individual methods)

VariantEpochsTop-1Top-5Energy (kWh)CO₂ (kg)Time (s)Status
M0baselinefp32500.69710.97520.46480.220822138completed
M1cacheonly500.67390.97260.49540.235323560completed
M2amponly500.10000.50000.26380.125312605completed
M3gradaccum_only500.76940.98640.51960.246824865completed
M4l1sparsity_only500.68880.97560.52340.248625183completed
M5adaptivelr_only500.86820.99400.52340.248624931completed
M6eagonly500.65090.97430.48000.228022937completed
M7fulle2am500.92190.99800.27540.130813151completed

C-matrix (cumulative ablation)

VariantEpochsTop-1Top-5Energy (kWh)CO₂ (kg)Time (s)Status
C0_baseline500.65610.97100.48990.232723158completed
C1_cache500.67100.97250.54730.260026205completed
C2cacheamp500.73970.98270.24290.115411595completed
C3cacheamp_gradaccum500.82760.99210.24620.116911765completed
C4cacheampgradaccumadaptivelr500.92850.99900.24770.117711828completed
C5cacheampgradaccumadaptivelr_l1500.92060.99810.25600.121612257completed
C6fulle2am500.92980.99800.25350.120412086completed

[image]

[image]

[image]

[image]

CIFAR-100

M-matrix (individual methods)

VariantEpochsTop-1Top-5Energy (kWh)CO₂ (kg)Time (s)Status
M0baselinefp32500.26440.57530.50270.238823952completed
M1cacheonly500.27190.59270.50190.238423896completed
M2amponly500.44280.75900.26580.126312851completed
M3gradaccum_only500.44830.76900.48820.231923150completed
M4l1sparsity_only500.25600.57660.50200.238523947completed
M5adaptivelr_only500.56510.85520.51540.244824572completed
M6eagonly500.29140.60350.50440.239624011completed
M7fulle2am500.73070.92690.27570.131013298completed

C-matrix (cumulative ablation)

VariantEpochsTop-1Top-5Energy (kWh)CO₂ (kg)Time (s)Status
C0_baseline500.28400.60290.47940.227722881completed
C1_cache500.29510.61820.46430.220522035completed
C2cacheamp500.44840.77200.23400.111111077completed
C3cacheamp_gradaccum500.57390.86000.23480.111511113completed
C4cacheampgradaccumadaptivelr500.71800.92440.25410.120711852completed
C5cacheampgradaccumadaptivelr_l1500.72530.92950.26170.124312605completed
C6fulle2am500.72320.92560.27600.131113333completed

[image]

[image]

[image]

[image]

Tiny-ImageNet

M-matrix (individual methods)

VariantEpochsTop-1Top-5Energy (kWh)CO₂ (kg)Time (s)Status
M0baselinefp32500.13590.35530.99920.474647630completed
M1cacheonly500.14160.36940.99390.472146972completed
M2amponly500.24240.51020.52470.249225279completed
M3gradaccum_only500.26400.53540.96530.458545545completed
M4l1sparsity_only500.13910.36581.04280.495349938completed
M5adaptivelr_only500.36140.63460.97060.461045838completed
M6eagonly500.12790.34830.97720.464246600completed
M7fulle2am500.58350.81550.52670.250225137completed

C-matrix (cumulative ablation)

VariantEpochsTop-1Top-5Energy (kWh)CO₂ (kg)Time (s)Status
C0_baseline500.13740.34991.02540.487148708completed
C1_cache500.13510.36950.95460.453445416completed
C2cacheamp500.23750.49990.49320.234323429completed
C3cacheamp_gradaccum500.37930.66320.49410.234723520completed
C4cacheampgradaccumadaptivelr500.58240.81360.50180.238423976completed
C5cacheampgradaccumadaptivelr_l1500.58570.81200.52050.247224838completed
C6fulle2am500.57610.81290.51850.246324824completed

[image]

[image]

[image]

[image]

Deployment results

No deployment results in this repo yet.

Methodology

Model: MobileViTv2 (~4.5M params).

Training protocol: from scratch, SGD with momentum 0.9, weight decay 5e-4, initial LR 0.1, 50 epochs, 1 warmup epoch. All variants share the same protocol so ablation comparison stays apples-to-apples across the matrix.

Input: native dataset resolution upsampled to 256x256 in-model via nn.Upsample (FX-traceable to keep D3/D4 INT8 quantization possible).

Optimization toggles (the 5 individual methods and their cumulative combinations):

MethodMechanism
Tensor cacheTraining images held in RAM as a normalized float tensor
AMPtorch.cuda.amp.autocast + GradScaler
Grad accum (x2)Accumulate gradients across 2 mini-batches
L1 sparsityLambda * sum(w_i) added to loss with lambda=1e-8
Cosine LRlr(t) = lr_max 0.5 (1 + cos(pi*t/T))
EAG early-stopEnergy-Aware Gain: stop when accuracy gain per joule plateaus

Energy measurement: GPU power sampled at 1 Hz via nvidia-smi --query-gpu=power.draw. Energy = trapezoidal integration over power-vs-time. CO₂ = energy_kWh * 0.475 (global average grid intensity).

Hardware: Single NVIDIA T4 (14.5 GB) on Kaggle.

Repository structure

runs/
  cifar10/
  cifar100/
  tiny_imagenet/
    individual_methods/M0..M7/   (history.csv, metrics_summary.json,
                                  best_model.pt, last_model.pt, config.yaml)
    cumulative_ablation/C0..C6/  (same)
paper_tables/                     (6 unified CSV tables)
comparison_plots/<dataset>/       (per-dataset plots)
comparison_plots/cross_dataset/   (cross-dataset plots)
README.md                         (this file)

Reproducibility

Each variant directory has a config.yaml with the exact configuration used. To reproduce:

  1. 1.huggingface-cli download Shanmuk4622/E2AM_MobileViTv2 --repo-type dataset
  2. 2.Load the e2am.py library and call the appropriate config factory
  3. 3.Run e2am.train_one_run(cfg)

Limitations

  • Energy measurement is GPU-only (via nvidia-smi); CPU/memory power not included
  • Pruning is mask-based; no wall-clock speedup without sparsity-aware runtime
  • INT8 (D3/D4) is CPU FX static quantization (fbgemm); may fail on transformer blocks. Failures logged in metrics.json rather than crashing.
  • Single-T4 reproduction; multi-GPU not validated
  • SGD@0.1 is suboptimal for some architectures; the paper compares variant-to-variant deltas which remain meaningful regardless

Citation

bibtex
@misc{e2am_ablation_mobilevitv2,
  title  = {E2AM: Energy-Aware Adaptive Model Training Ablation Study (MobileViTv2)},
  author = {Shanmuk},
  year   = {2026},
  howpublished = {\url{https://huggingface.co/datasets/Shanmuk4622/E2AM_MobileViTv2}},
}

This README was auto-generated on 2026-06-06 12:37 UTC. Source repo: Shanmuk4622/E2AMMobileViTv2_