CoolFace
Modelpublic

OpenMatch/t5-ance

sourceHugging Facemitupdated 3y agoView on Hugging Face
1likes82downloads
Model Card

T5-ANCE

T5-ANCE generally follows the training procedure described in this page, but uses a much larger batch size.

Dataset used for training:

  • MS MARCO Passage

Evaluation result:

DatasetMetricResult
MS MARCO Passage (dev)MRR@100.3570

Important hyper-parameters:

NameValue
Global batch size256
Learning rate5e-6
Maximum length of query32
Maximum length of document128
Template for query<text>
Template for documentTitle: <title> Text: <text>

Paper

\-