IrvinTopi/WebFAQHardNegatives

WebFAQ 2.0: Multilingual Hard Negatives This dataset contains mined hard negatives derived from the WebFAQ 2.0 corpus. It includes approximately 1.3 million samples across 20 languages. The dataset is designed to support robust training of dense retrieval models, specifically enabling: Contrastive Learning: Using strict hard negatives to improve discrimination. Knowledge Distillation: Using the provided cross-encoder scores to train with soft labels (e.g., MarginMSE).… See the full description on the dataset page: https://huggingface.co/datasets/IrvinTopi/WebFAQHardNegatives.