Modelpublic

raghvendramall/pearl-benchmark-models

sourceHugging Faceupdated 27d agoView on Hugging Face

0likes

Model Card

PEARL Benchmark -- Top-5 Models per Dataset

Parameter-Efficient Adaptation with Retrieval-Augmented Learning for Molecular Property Prediction. Each dataset folder below holds its top-5 best-performing methods, ranked by the dataset's primary metric.

Code: https://github.com/raghvendra5688/PEARL

BACE (classification, ranked by MCC)

Rank	Method	MCC	Configuration	Path
1	E2E LoRA -- Uni-Mol	0.6234	Weighted Loss	BACE/rank1_e2e-lora-uni-mol
2	E2E LoRA -- HF	0.5660	ibm_MoLFormerXLboth_10pct, fl	BACE/rank2_e2e-lora-hf
3	FT Embed	0.5570	MolFormerFinetunedFL	BACE/rank3_ft-embed
4	RAFE	0.5570	MolFormerFinetunedFL	BACE/rank4_rafe
5	FT Embed+PC	0.5500	MolformerFinetunedWL_embeddings	BACE/rank5_ft-embed-pc

BBBP (classification, ranked by MCC)

Rank	Method	MCC	Configuration	Path
1	RAFE	0.7980	MolFormerFinetunedFL	BBBP/rank1_rafe
2	FT Embed+PC	0.7890	MolFormerFinetunedFL_embeddings	BBBP/rank2_ft-embed-pc
3	FT Embed	0.7870	MolFormerFinetunedFL	BBBP/rank3_ft-embed
4	E2E LoRA -- Uni-Mol	0.7740	Weighted Loss	BBBP/rank4_e2e-lora-uni-mol
5	E2E LoRA -- HF	0.7670	ibm_MoLFormerXLboth_10pct, fl	BBBP/rank5_e2e-lora-hf

FLAVOR (classification, ranked by MCC)

Rank	Method	MCC	Configuration	Path
1	Chemprop	0.8090	D-MPNN	FLAVOR/rank1_chemprop
2	PC-only	0.8080	XGBoost	FLAVOR/rank2_pc-only
3	E2E LoRA -- HF	0.8020	DeepChem_ChemBERTa77M_MTR, wl	FLAVOR/rank3_e2e-lora-hf
4	FT Embed+PC	0.8010	MolformerFinetunedWL_embeddings	FLAVOR/rank4_ft-embed-pc
5	RAFE	0.8000	ChemBERTa77MMTR_FL	FLAVOR/rank5_rafe

HERG (classification, ranked by MCC)

Rank	Method	MCC	Configuration	Path
1	E2E LoRA -- Uni-Mol	0.6093	Weighted Loss	HERG/rank1_e2e-lora-uni-mol
2	PC-only	0.6040	XGBoost	HERG/rank2_pc-only
3	FT Embed+PC	0.6015	UniMol_FL	HERG/rank3_ft-embed-pc
4	RAFE	0.5889	UniMol_FL	HERG/rank4_rafe
5	FT Embed	0.5798	UniMol_FL	HERG/rank5_ft-embed

DILI (classification, ranked by MCC)

Rank	Method	MCC	Configuration	Path
1	RAFE	0.7897	UniMol_FL	DILI/rank1_rafe
2	E2E LoRA -- HF	0.7704	DeepChem_ChemBERTa77M_MTR, wl	DILI/rank2_e2e-lora-hf
3	PC-only	0.7650	CatBoost	DILI/rank3_pc-only
4	GCN	0.7280	GINConv	DILI/rank4_gcn
5	E2E LoRA -- Uni-Mol	0.7079	Focal Loss	DILI/rank5_e2e-lora-uni-mol

CACO2 (regression, ranked by Spearman)

Rank	Method	Spearman	Configuration	Path
1	PC-only	0.8534	CatBoost	CACO2/rank1_pc-only
2	RAFE	0.8347	ChemBERTa77MMTR_Huber	CACO2/rank2_rafe
3	FT Embed+PC	0.8271	ChemBERTa77MMTR_Huber	CACO2/rank3_ft-embed-pc
4	FT Embed	0.8211	ChemBERTa77MMTR_Huber	CACO2/rank4_ft-embed
5	Chemprop	0.8022	D-MPNN	CACO2/rank5_chemprop

HALF_LIFE (regression, ranked by Spearman)

Rank	Method	Spearman	Configuration	Path
1	FT Embed	0.6226	MolFormerFinetunedHuber	HALF_LIFE/rank1_ft-embed
2	FT Embed+PC	0.5927	MolFormerFinetunedHuber	HALF_LIFE/rank2_ft-embed-pc
3	RAFE	0.5684	MolFormerFinetunedHuber	HALF_LIFE/rank3_rafe
4	E2E LoRA -- HF	0.5406	DeepChem_ChemBERTa77M_MTR, huber	HALF_LIFE/rank4_e2e-lora-hf
5	PC-only	0.5211	CatBoost	HALF_LIFE/rank5_pc-only