clarin-pl/PUGG_MRC

PUGG: KBQA, MRC, IR Dataset for Polish

Description

This repository contains the PUGG dataset designed for three NLP tasks in the Polish language:

• —KBQA (Knowledge Base Question Answering)
• —MRC (Machine Reading Comprehension)
• —IR (Information Retrieval)

Paper

For more detailed information, please refer to our research paper titled:

"Developing PUGG for Polish: A Modern Approach to KBQA, MRC, and IR Dataset Construction"

Authored by:

• —Albert Sawczyn
• —Katsiaryna Viarenich
• —Konrad Wojtasik
• —Aleksandra Domogała
• —Marcin Oleksy
• —Maciej Piasecki
• —Tomasz Kajdanowicz

The paper was accepted for ACL 2024 (findings).

Repositories

The dataset is available in the following repositories:

• —General - contains all tasks (KBQA, MRC, IR*)

For more straightforward usage, the tasks are also available in separate repositories:

• —KBQA
• —MRC (this repository)
• —IR

The knowledge graph for KBQA task is available in the following repository:

• —Knowledge Graph

Note: If you want to utilize the IR task in the BEIR format (qrels in .tsv format), please download the IR repository.

Links

• —Code:
• —Github
• —Paper:
• —ACL - TBA
• —Arxiv

Citation

@misc{sawczyn2024developingpuggpolishmodern,
      title={Developing PUGG for Polish: A Modern Approach to KBQA, MRC, and IR Dataset Construction}, 
      author={Albert Sawczyn and Katsiaryna Viarenich and Konrad Wojtasik and Aleksandra Domogała and Marcin Oleksy and Maciej Piasecki and Tomasz Kajdanowicz},
      year={2024},
      eprint={2408.02337},
      archivePrefix={arXiv},
      primaryClass={cs.AI},
      url={https://arxiv.org/abs/2408.02337}, 
}

Contact

albert.sawczyn@pwr.edu.pl

Usage

from datasets import load_dataset

dataset = load_dataset("clarin-pl/PUGG_MRC")
print(dataset)