Karavet/ARPA-Armenian-Paraphrase-Corpus

Table of Contents

• —Table of Contents
• —Dataset Description
• —Dataset Summary
• —Dataset Structure
• —Dataset Evaluation
• —Additional Information

Dataset Description

We provide sentential paraphrase detection train, test datasets as well as BERT-based models for the Armenian language.

Dataset Summary

The sentences in the dataset are taken from Hetq and Panarmenian news articles. To generate paraphrase for the sentences, we used back translation from Armenian to English. We repeated the step twice, after which the generated paraphrases were manually reviewed. Invalid sentences were filtered out, while the rest were labelled as either paraphrase, near paraphrase or non-paraphrase. Test examples were reviewed by 3 different annotators. In addition, to increase the number of non-paraphrase pairs, we padded the dataset with automatically generated negative examples, including pairs of consecutive sentences and random pairs.

Dataset Structure

Each row consists of 2 sentences and their label. This sentences were labelled as either paraphrase, near paraphrase or non-paraphrase (with 1, 0, -1 labels respectively). The sentences are divided into train and test sets.

Dataset Evaluation

We finetuned Multilingual BERT on several training sets, including the proposed ARPA dataset, and evaluated their performance on our test set. During training and evaluation, near paraphrase and non-paraphrase pairs were combined into one class. The results are provided below:

Additional Information

The model trained on ARPA is available for use, and can be downloaded using this link.

For more details about the models and dataset construction, refer to the paper.