quickmt/quickmt-train.hi-en

quickmt hi-en Training Corpus

Contains the following datasets downloaded with mtdata after deduplication and basic filtering with quickmt:

• —IITB-hien_dev-1.5-hin-eng
• —Neulab-tedtalks_test-1-eng-hin
• —Google-wmt24pp-1-eng-hin_IN
• —IITB-hien_test-1.5-hin-eng
• —Statmt-news_commentary-14-eng-hin
• —Statmt-news_commentary-15-eng-hin
• —Statmt-news_commentary-16-eng-hin
• —Statmt-news_commentary-17-eng-hin
• —Statmt-news_commentary-18-eng-hin
• —Statmt-news_commentary-18.1-eng-hin
• —Statmt-pmindia-1-eng-hin
• —JoshuaDec-indian_training-1-hin-eng
• —Facebook-wikimatrix-1-eng-hin
• —IITB-hien_train-1.5-hin-eng
• —Neulab-tedtalks_train-1-eng-hin
• —Neulab-tedtalks_dev-1-eng-hin
• —ELRC-wikipedia_health-1-eng-hin
• —Anuvaad-internaljudicial2021-v1-eng-hin
• —Anuvaad-legalterms2021-v1-eng-hin
• —Anuvaad-pib_2017-2020-eng-hin
• —Anuvaad-pibarchives_2009-2016-eng-hin
• —Anuvaad-wikipedia-20210201-eng-hin
• —Anuvaad-drivespark-20210303-eng-hin
• —Anuvaad-nativeplanet-20210315-eng-hin
• —Anuvaad-catchnews-20210320-eng-hin
• —Anuvaad-dwnews_2008-2020-eng-hin
• —Anuvaad-oneindia-20210320-eng-hin
• —Anuvaad-mk-20210320-eng-hin
• —Anuvaad-goodreturns-20210320-eng-hin
• —Anuvaad-ie_sports-20210320-eng-hin
• —Anuvaad-ie_tech-20210320-eng-hin
• —Anuvaad-ie_news-20210320-eng-hin
• —Anuvaad-ie_lifestyle-20210320-eng-hin
• —Anuvaad-ie_general-20210320-eng-hin
• —Anuvaad-ie_entertainment-20210320-eng-hin
• —Anuvaad-ie_education-20210320-eng-hin
• —Anuvaad-ie_business-20210320-eng-hin
• —Anuvaad-fin_express-20210320-eng-hin
• —Anuvaad-thewire-20210320-eng-hin
• —Anuvaad-tribune-20210320-eng-hin
• —Anuvaad-zeebiz-20210320-eng-hin
• —Anuvaad-pa_govt-20210320-eng-hin
• —Anuvaad-betterindia-20210320-eng-hin
• —Anuvaad-jagran_news-20210320-eng-hin
• —Anuvaad-jagran_tech-20210320-eng-hin
• —Anuvaad-jagran_education-20210320-eng-hin
• —Anuvaad-jagran_entertainment-20210320-eng-hin
• —Anuvaad-jagran_business-20210320-eng-hin
• —Anuvaad-jagran_sports-20210320-eng-hin
• —Anuvaad-jagran_lifestyle-20210320-eng-hin
• —Anuvaad-asianetnews-20210320-eng-hin
• —Anuvaad-business_standard-20210320-eng-hin
• —Anuvaad-pranabmukherjee-20210320-eng-hin
• —Anuvaad-lokmat_entertainment-20210501-eng-hin
• —Anuvaad-lokmat_news-20210501-eng-hin
• —Anuvaad-lokmat_lifestyle-20210501-eng-hin
• —Anuvaad-lokmat_sports-20210501-eng-hin
• —Anuvaad-lokmat_tech-20210501-eng-hin
• —Anuvaad-lokmat_financial-20210501-eng-hin
• —Anuvaad-lokmat_healthcare-20210501-eng-hin
• —AllenAi-nllb-1-eng-hin
• —OPUS-anuvaad-v1-eng-hin
• —OPUS-ccmatrix-v1-eng-hin
• —OPUS-elrc3061wikipedia_health-v1-eng-hin
• —OPUS-elrcwikipediahealth-v1-eng-hin
• —OPUS-elrc_2922-v1-eng-hin
• —OPUS-gnome-v1-eng-hin
• —OPUS-gnome-v1-eng_US-hin
• —OPUS-globalvoices-v2015-eng-hin
• —OPUS-globalvoices-v2017q3-eng-hin
• —OPUS-globalvoices-v2018q4-eng-hin
• —OPUS-hplt-v1-eng-hin
• —OPUS-hplt-v2-eng-hin
• —OPUS-iitb-v2.0-eng-hin
• —OPUS-joshua_ipc-v1-eng-hin
• —OPUS-kde4-v2-eng-hin
• —OPUS-multihplt-v2-eng-hin
• —OPUS-nllb-v1-eng-hin
• —OPUS-neulab_tedtalks-v1-eng-hin
• —OPUS-news_commentary-v14-eng-hin
• —OPUS-news_commentary-v16-eng-hin
• —OPUS-opensubtitles-v2024-eng-hin
• —OPUS-paracrawl_bonus-v9-eng-hin
• —OPUS-qed-v2.0a-eng-hin
• —OPUS-samanantar-v0.2-eng-hin
• —OPUS-ted2020-v1-eng-hin
• —OPUS-tanzil-v1-eng-hin
• —OPUS-tatoeba-v2-eng-hin
• —OPUS-tatoeba-v20190709-eng-hin
• —OPUS-tatoeba-v20200531-eng-hin
• —OPUS-tatoeba-v20201109-eng-hin
• —OPUS-tatoeba-v20210310-eng-hin
• —OPUS-tatoeba-v20210722-eng-hin
• —OPUS-tatoeba-v20220303-eng-hin
• —OPUS-tatoeba-v20230412-eng-hin
• —OPUS-ubuntu-v14.10-eng-hin
• —OPUS-ubuntu-v14.10-eng_US-hin
• —OPUS-wmt_news-v2014-eng-hin
• —OPUS-wmt_news-v2019-eng-hin
• —OPUS-wikimatrix-v1-eng-hin
• —OPUS-xlent-v1.2-eng-hin
• —OPUS-bible_uedin-v1-eng-hin
• —OPUS-pmindia-v1-eng-hin
• —OPUS-tico_19-v20201028-eng-hin
• —OPUS-tldr_pages-v20230829-eng-hin
• —OPUS-wikimedia-v20210402-eng-hin
• —OPUS-wikimedia-v20230407-eng-hin