webis/tiny-bert-ranker

tiny-bert-ranker model card

This model is a fine-tuned version of prajjwal1/bert-tiny as part of our submission to ReNeuIR 2024.

Model Details

Model Description

<!-- Provide a longer summary of what this model is. -->

The model is based on the pre-trained prajjwal1/bert-tiny. It is fine-tuned on a 1GB subset of data extracted from msmarco's Train Triples Small.

Tiny-bert-ranker is part of our investigation into the tradeoffs between efficiency and effectiveness in ranking models. This approach does not involve BM25 score injection or distillation.

• —Developed by: Team FSU at ReNeuIR 2024
• —Model type: sequence-to-sequence model
• —License: mit
• —Finetuned from model: prajjwal1/bert-tiny