Modelpublic

richardyoung/CardioEmbed-BioLinkBERT

sourceHugging Faceapache-2.0updated 10mo agoView on Hugging Face

0likes35downloads

training_config.json18 linesDownload Raw Back to root

1{2  "name": "BioLinkBERT-large",3  "model_id": "michiyasunaga/BioLinkBERT-large",4  "batch_size": 64,5  "gradient_accumulation_steps": 1,6  "learning_rate": 2e-05,7  "epochs": 3,8  "max_seq_length": 512,9  "lora_r": 16,10  "lora_alpha": 32,11  "use_8bit": false,12  "target_modules": [13    "query",14    "key",15    "value"16  ],17  "output_dir": "biolinkbert_cardiology"18}