rustambekurokov/esm2-8m-protein-localization

ESM-2 8M — Protein Subcellular Localization (Linear Probe)

Fine-tuned ESM-2 8M for protein subcellular localization (10 classes). All ESM-2 layers frozen — only the classification head was trained.

Results

Architecture

ESM-2 8M (frozen) → Mean pooling → LayerNorm → Linear(320→80) → GELU → Linear(80→10)

Training

• —Dataset: DeepLoc 2.0 (17,266 train / 3,700 val / 3,701 test)
• —Strategy: Linear probe (backbone frozen, head only)
• —Epochs: 15
• —Learning rate: 1e-3
• —Hardware: NVIDIA DGX Spark

All Models in This Project

Links

• —Demo: HuggingFace Space
• —Code: GitHub