Iambackup/gpn-brassicales
09
GPN trained on Arabidopsis thaliana and 7 other Brassicales
See https://github.com/songlab-cal/gpn for more details.
Basic usage:
import gpn.model
from transformers import AutoModel, AutoModelForMaskedLM
model = AutoModel.from_pretrained("songlab/gpn-brassicales")
# or
model = AutoModelForMaskedLM.from_pretrained("songlab/gpn-brassicales")Some hparams:
- repeat_weight: 0.1
- lr: 120k at 1e-3 + 30k cosine decay
