quickmt/quickmt-train.zh-en

quickmt zh-en Training Corpus

Contains the following datasets downloaded with mtdata after deduplication and basic filtering with quickmt:

• —Statmt-newscommentarywmt18-13-zho-eng
• —Statmt-news_commentary-14-eng-zho
• —Statmt-news_commentary-15-eng-zho
• —Statmt-news_commentary-16-eng-zho
• —Statmt-news_commentary-17-eng-zho
• —Statmt-news_commentary-18-eng-zho
• —Statmt-news_commentary-18.1-eng-zho
• —Statmt-wiki_titles-1-zho-eng
• —Statmt-wiki_titles-2-zho-eng
• —Statmt-wikititles-3-zho-eng
• —Statmt-newsdev_zhen-2017-zho-eng
• —Statmt-newsdev_enzh-2017-eng-zho
• —Statmt-newstest_zhen-2017-zho-eng
• —Statmt-newstest_enzh-2017-eng-zho
• —Statmt-newstest_zhen-2018-zho-eng
• —Statmt-newstest_enzh-2018-eng-zho
• —Statmt-newstest_zhen-2019-zho-eng
• —Statmt-newstest_enzh-2019-eng-zho
• —Statmt-generaltest-2022_refA-eng-zho
• —Statmt-generaltest-2022_refB-eng-zho
• —Statmt-generaltest-2022_refA-zho-eng
• —Statmt-generaltest-2022_refB-zho-eng
• —Statmt-newstest_enzh-2020-eng-zho
• —Statmt-newstest_zhen-2020-zho-eng
• —Statmt-newstestb_enzh-2020-eng-zho
• —Statmt-newstestb_zhen-2020-zho-eng
• —Statmt-ccaligned-1-eng-zho_CN
• —Statmt-ccaligned-1-eng-zho_TW
• —Statmt-backtrans_enzh-wmt20-eng-zho
• —ParaCrawl-paracrawl-1_bonus-eng-zho
• —Neulab-tedtalks_train-1-eng-zho
• —Neulab-tedtalks_test-1-eng-zho
• —Neulab-tedtalks_dev-1-eng-zho
• —OPUS-gnome-v1-eng-zho_CN
• —OPUS-gnome-v1-eng-zho_HK
• —OPUS-gnome-v1-eng-zho_TW
• —OPUS-kde4-v2-eng-zho_CN
• —OPUS-kde4-v2-eng-zho_HK
• —OPUS-kde4-v2-eng-zho_TW
• —OPUS-kde4-v2-engGB-zhoCN
• —OPUS-kde4-v2-engGB-zhoHK
• —OPUS-kde4-v2-engGB-zhoTW
• —OPUS-kdedoc-v1-engGB-zhoTW
• —OPUS-linguatools_wikititles-v2014-eng-zho
• —OPUS-mdnwebdocs-v20230925-eng-zho_CN
• —OPUS-mdnwebdocs-v20230925-eng-zho_TW
• —OPUS-nllb-v1-eng-zho
• —OPUS-nllb-v1-eng-zho_TW
• —OPUS-neulab_tedtalks-v1-eng-zho
• —OPUS-neulabtedtalks-v1-eng-zhoCN
• —OPUS-neulabtedtalks-v1-eng-zhoTW
• —OPUS-news_commentary-v11-eng-zho
• —OPUS-news_commentary-v14-eng-zho
• —OPUS-news_commentary-v16-eng-zho
• —OPUS-news_commentary-v9.0-eng-zho
• —OPUS-news_commentary-v9.1-eng-zho
• —OPUS-openoffice-v3-engGB-zhoCN
• —OPUS-opensubtitles-v1-eng-zho
• —OPUS-opensubtitles-v2016-eng-zho
• —OPUS-php-v1-eng-zho
• —OPUS-php-v1-eng-zho_TW
• —OPUS-paracrawl-v9-eng-zho
• —OPUS-paracrawl_bonus-v9-eng-zho
• —OPUS-qed-v2.0a-eng-zho
• —OPUS-spc-v1-eng-zho
• —OPUS-ted2013-v1.1-eng-zho
• —OPUS-ted2020-v1-eng-zho
• —OPUS-ted2020-v1-eng-zho_CN
• —OPUS-ted2020-v1-eng-zho_TW
• —OPUS-tanzil-v1-eng-zho
• —OPUS-unpc-v1.0-eng-zho
• —OPUS-ubuntu-v14.10-eng-zho
• —OPUS-ubuntu-v14.10-eng-zho_CN
• —OPUS-ubuntu-v14.10-eng-zho_HK
• —OPUS-ubuntu-v14.10-eng-zho_TW
• —OPUS-wmt_news-v2019-eng-zho
• —OPUS-wikimatrix-v1-eng-zho
• —OPUS-wikititles-v3-eng-zho
• —OPUS-xlent-v1-eng-zho
• —OPUS-xlent-v1.1-eng-zho
• —OPUS-xlent-v1.2-eng-zho
• —OPUS-bible_uedin-v1-eng-zho
• —OPUS-infopankki-v1-eng-zho
• —OPUS-tico_19-v20201028-eng-zho
• —OPUS-tldr_pages-v20230829-eng-zho
• —OPUS-wikimedia-v20190628-eng-zho_TW
• —OPUS-wikimedia-v20210402-eng-zho
• —OPUS-wikimedia-v20210402-eng-zho_TW
• —OPUS-wikimedia-v20230407-eng-zho
• —OPUS-wikimedia-v20230407-eng-zho_TW
• —OPUS-opus100_train-1-eng-zho
• —OPUS-opus100_dev-1-eng-zho
• —OPUS-opus100_test-1-eng-zho