opus
Datasets
All datasets matching “opus”opus-100
Dataset Card for OPUS-100
Dataset Summary
OPUS-100 is an English-centric multilingual corpus covering 100 languages.
OPUS-100 is English-centric, meaning that all training pairs include English on either the source or target side. The corpus covers 100 languages (including English).
The languages were selected based on the volume of parallel data available in OPUS.
Supported Tasks and Leaderboards
Translation.
Languages
OPUS-100 contains… See the full description on the dataset page: https://huggingface.co/datasets/Helsinki-NLP/opus-100.English-Zomi-OPUS_Tatoeba_v20230412
English–Zomi Parallel Corpus (1.78M)
This dataset contains 1.78 million English–Zomi sentence pairs, created to support
machine translation, linguistic research, and large‑scale language model training.
It is fully open and permissively licensed for commercial and non‑commercial use.
🌐 Linguistic Background: Zomi, Tedim Chin, and ISO Codes
Zomi is the endonym (self‑chosen name) of the people and their language.However, Zomi does not yet have an official ISO 639‑3 code.… See the full description on the dataset page: https://huggingface.co/datasets/ZomiLearner/English-Zomi-OPUS_Tatoeba_v20230412.opus_books
Dataset Card for OPUS Books
Dataset Summary
This is a collection of copyright free books aligned by Andras Farkas, which are available from http://www.farkastranslations.com/bilingual_books.php
Note that the texts are rather dated due to copyright issues and that some of them are manually reviewed (check the meta-data at the top of the corpus files in XML). The source is multilingually aligned, which is available from http://www.farkastranslations.com/bilingual_books.php.… See the full description on the dataset page: https://huggingface.co/datasets/Helsinki-NLP/opus_books.Opus-WritingPrompts
Opus Writing Prompts
This is a dataset containing 3008 short stories, generated by an unrestrained Claude Opus using Reddit's Writing Prompts as a source. Each sample is generally between 4000-6000 characters long.
These stories were thoroughly cleaned and then further enriched with a title and a series of applicable genres.
Disclaimer: This dataset is extremely varied and includes erotica. You have been warned.
Three files are included:
A ShareGPT dataset, ready to be used for… See the full description on the dataset page: https://huggingface.co/datasets/Gryphe/Opus-WritingPrompts.OPUS_GlobalVoicesOPUS
Collection of OPUS
Corpus from https://opus.nlpl.eu has been collected. The following corpora have been included:
UNPC
GlobalVoices
TED2020
News-Commentary
WikiMatrix
Tatoeba
Europarl
OpenSubtitles
25,000 samples (randomly sampled within the first 100,000 samples) per language pair of each corpus were collected, with no modification of data.
Licenses
OPUS
@inproceedings{tiedemann2012parallel,
title={Parallel data, tools and interfaces in OPUS.}… See the full description on the dataset page: https://huggingface.co/datasets/wecover/OPUS.