Datasetpublic

Viet-Mistral/CulturaY

CulturaY: A Large Cleaned Multilingual Dataset of 75 Languages Dataset Summary From the team that brought you CulturaX, we present CulturaY, another substantial multilingual dataset of 15TB (uncompressed)/3TB (zstd-compressed) that applies the same dataset cleaning methodology to the HPLT v1.1 dataset. Please note that HPLT v1.2 has also been released and is an alternative verison with different cleaning methodolgies. This data was used in part to train our SOTA… See the full description on the dataset page: https://huggingface.co/datasets/Viet-Mistral/CulturaY.

sourceHugging Facecc-by-4.0updated 2y agoView on Hugging Face

39likes6.5kdownloads

50 commits on main

dc71d242y ago

Update README.md

huu-ontocord

f82fef12y ago

Update README.md

huu-ontocord

234a0992y ago

Update README.md

huu-ontocord

d57108f3y ago

Update README.md

huu-ontocord

ea915923y ago

Update README.md

huu-ontocord

5fb92d33y ago

Update README.md

huu-ontocord

aaa41103y ago

Update README.md

huu-ontocord

a72d0073y ago

Update README.md

huu-ontocord

a501f1c3y ago

Update README.md

huu-ontocord

cd763d73y ago

Update README.md

huu-ontocord

fa438d13y ago

Update README.md

nguyenhuuthuat09

f89cb093y ago

Update README.md

nguyenhuuthuat09

f4107463y ago

Update README.md

huu-ontocord

c6321d93y ago

Update README.md

huu-ontocord

e298f833y ago

Update README.md

nguyenhuuthuat09

37c06a93y ago

Update README.md

huu-ontocord

6cda0e03y ago

Fix files extension (#2)

nguyenhuuthuat09, lhoestq

0093cfe3y ago

Update README.md

nguyenhuuthuat09

f30cba83y ago

Update README.md

nguyenhuuthuat09

79b47ab3y ago

Update README.md

nguyenhuuthuat09

a6a87033y ago

Update README.md

huu-ontocord

dcc28443y ago

Update README.md

huu-ontocord

2405daf3y ago

Update README.md

huu-ontocord

17c2b533y ago

Update README.md

huu-ontocord

849736d3y ago

Create README.md

huu-ontocord

592ac2c3y ago