Datasetpublic

lvwerra/stack-exchange-paired

StackExchange Paired This is a processed version of the HuggingFaceH4/stack-exchange-preferences. The following steps were applied: Parse HTML to Markdown with markdownify Create pairs (response_j, response_k) where j was rated better than k Sample at most 10 pairs per question Shuffle the dataset globally This dataset is designed to be used for preference learning. The processing notebook is in the repository as well.

sourceHugging Faceupdated 4y agoView on Hugging Face

150likes3.3kdownloads

Dataset Card

StackExchange Paired

This is a processed version of the `HuggingFaceH4/stack-exchange-preferences`. The following steps were applied:

—Parse HTML to Markdown with markdownify
—Create pairs (response_j, response_k) where j was rated better than k
—Sample at most 10 pairs per question
—Shuffle the dataset globally

This dataset is designed to be used for preference learning. The processing notebook is in the repository as well.