CluelessNovice/demo_cls1216

basemodel: ProTrekHub/ProteinEncoder_35M

library_name: peft

Model Card for Model-demo-35M

This model is used for a demo classification task

Task type

Protein-level Regression

Model input type

AA Sequence

Label meanings

A, B

LoRA config

• —r: 8
• —lora_dropout: 0.0
• —lora_alpha: 16
• —target_modules: ['intermediate.dense', 'value', 'query', 'output.dense', 'key']
• —modules_to_save: ['classifier']

Training config

• —optimizer:
• —class: AdamW
• —betas: (0.9, 0.98)
• —weight_decay: 0.01
• —learning rate: 0.001
• —epoch: 10
• —batch size: 2
• —precision: 16-mixed