datasets
Training and evaluation data, with the modality, task and licence stated up front. Listed live from the Hugging Face Hub.
DATA_SDXL_AntiqueDataset for making a LoRA called "SDXL Antique" on realistic base models of Illustrious.
antique
Dataset Card for antique
The antique dataset, provided by the ir-datasets package.
For more information about the dataset, see the documentation.
Data
This dataset provides:
docs (documents, i.e., the corpus); count=403,666
This dataset is used by: antique_test, antique_test_non-offensive, antique_train, antique_train_split200-train, antique_train_split200-valid
Usage
from datasets importload_dataset
docs = load_dataset('irds/antique', 'docs')
for record in… See the full description on the dataset page: https://huggingface.co/datasets/irds/antique.antique_train
Dataset Card for antique/train
The antique/train dataset, provided by the ir-datasets package.
For more information about the dataset, see the documentation.
Data
This dataset provides:
queries (i.e., topics); count=2,426
qrels: (relevance assessments); count=27,422
For docs, use irds/antique
Usage
from datasets import load_dataset
queries = load_dataset('irds/antique_train', 'queries')
for record in queries:
record # {'query_id': ..., 'text': ...}… See the full description on the dataset page: https://huggingface.co/datasets/irds/antique_train.antique_train_split200-train
Dataset Card for antique/train/split200-train
The antique/train/split200-train dataset, provided by the ir-datasets package.
For more information about the dataset, see the documentation.
Data
This dataset provides:
queries (i.e., topics); count=2,226
qrels: (relevance assessments); count=25,229
For docs, use irds/antique
Usage
from datasets import load_dataset
queries = load_dataset('irds/antique_train_split200-train', 'queries')
for record in queries:… See the full description on the dataset page: https://huggingface.co/datasets/irds/antique_train_split200-train.airship-books-antique
pszemraj/airship-books-antique
Digitized books (via a VLM) on airships from the survivor library
antique_test_non-offensive
Dataset Card for antique/test/non-offensive
The antique/test/non-offensive dataset, provided by the ir-datasets package.
For more information about the dataset, see the documentation.
Data
This dataset provides:
queries (i.e., topics); count=176
qrels: (relevance assessments); count=5,752
For docs, use irds/antique
Usage
from datasets import load_dataset
queries = load_dataset('irds/antique_test_non-offensive', 'queries')
for record in queries:
record… See the full description on the dataset page: https://huggingface.co/datasets/irds/antique_test_non-offensive.antique_train_split200-valid
Dataset Card for antique/train/split200-valid
The antique/train/split200-valid dataset, provided by the ir-datasets package.
For more information about the dataset, see the documentation.
Data
This dataset provides:
queries (i.e., topics); count=200
qrels: (relevance assessments); count=2,193
For docs, use irds/antique
Usage
from datasets import load_dataset
queries = load_dataset('irds/antique_train_split200-valid', 'queries')
for record in queries:… See the full description on the dataset page: https://huggingface.co/datasets/irds/antique_train_split200-valid.antique_test
Dataset Card for antique/test
The antique/test dataset, provided by the ir-datasets package.
For more information about the dataset, see the documentation.
Data
This dataset provides:
queries (i.e., topics); count=200
qrels: (relevance assessments); count=6,589
For docs, use irds/antique
Usage
from datasets import load_dataset
queries = load_dataset('irds/antique_test', 'queries')
for record in queries:
record # {'query_id': ..., 'text': ...}
qrels =… See the full description on the dataset page: https://huggingface.co/datasets/irds/antique_test.