Modelpublic

Rostlab/prot_bert_bfd

sourceHugging Faceupdated 6y agoView on Hugging Face

18likes17kdownloads

config.json17 linesDownload Raw Back to root

1{2  "architectures": [3    "BertForMaskedLM"4  ],5  "attention_probs_dropout_prob": 0.0,6  "hidden_act": "gelu",7  "hidden_dropout_prob": 0.0,8  "hidden_size": 1024,9  "initializer_range": 0.02,10  "intermediate_size": 4096,11  "max_position_embeddings": 40000,12  "num_attention_heads": 16,13  "num_hidden_layers": 30,14  "type_vocab_size": 2,15  "vocab_size": 3016}17