FrancophonIA/COVID-19_HEALTH

[!NOTE] Dataset origin: https://live.european-language-grid.eu/catalogue/corpus/21222 Description The dataset contains 327 X-Y TMX files, where X and Y belong to the set {CEF language plus IS and NO} (3905604 TUs in total). Acquisition of data (from multi/bi-lingual websites), normalization, cleaning, deduplication and identification of parallel documents have been done by ILSP-FC tool. Multilingual embeddings (LASER) were used for alignment of segments. Merging/filtering of… See the full description on the dataset page: https://huggingface.co/datasets/FrancophonIA/COVID-19_HEALTH.