Modelpublic

luhua/chinese_pretrain_mrc_roberta_wwm_ext_large

sourceHugging Faceapache-2.0updated 5y agoView on Hugging Face

87likes202downloads

Model Card

Chinese MRC robertawwmext_large

—使用大量中文MRC数据训练的robertawwmextlarge模型，详情可查看：https://github.com/basketballandlearn/MRCCompetition_Dureader
—此库发布的再训练模型，在阅读理解/分类等任务上均有大幅提高<br/> （已有多位小伙伴在Dureader-2021等多个比赛中取得top5的成绩😁）

模型/数据集	Dureader-2021	tencentmedical
	F1-score	Accuracy
	dev / A榜	test-1
macbert-large (哈工大预训练语言模型)	65.49 / 64.27	82.5
roberta-wwm-ext-large (哈工大预训练语言模型)	65.49 / 64.27	82.5
macbert-large (ours)	70.45 / 68.13	83.4
roberta-wwm-ext-large (ours)	68.91 / 66.91	83.1