BlossomsAI/vietnamese-corpus
Vietnamese Combined Corpus Dataset Statistics Total documents: {<15M:,} Wikipedia articles: {>1.3M:,} News articles: {>13M:,} Text documents: {>200K:,} Processing Details Processed using Apache Spark Minimum document length: {10} characters Text cleaning applied: HTML/special character removal Whitespace normalization URL removal Empty document filtering Data Format Each document has: 'text': The document content 'source':… See the full description on the dataset page: https://huggingface.co/datasets/BlossomsAI/vietnamese-corpus.
This repository belongs to BlossomsAI on Hugging Face.
CoolFace never edits a repository it does not host. Visibility, licence, collaborators and gating are all managed at the source.