R5dwMg/zh-wiki-yue-long
Dataset Description This dataset, named zh-wiki-yue-long, is crawled from the Yue (Cantonese) version of Wikipedia. It contains a collection of articles with an emphasis on long sentences, providing a rich source for understanding complex structures in Yue text. The dataset is designed for research in natural language processing (NLP) and machine learning tasks involving Yue text. Data Content Language: Yue (Cantonese) Source: https://zh-yue.wikipedia.org Type:… See the full description on the dataset page: https://huggingface.co/datasets/R5dwMg/zh-wiki-yue-long.
Dataset Description
This dataset, named zh-wiki-yue-long, is crawled from the Yue (Cantonese) version of Wikipedia. It contains a collection of articles with an emphasis on long sentences, providing a rich source for understanding complex structures in Yue text. The dataset is designed for research in natural language processing (NLP) and machine learning tasks involving Yue text.
Data Content
- Language: Yue (Cantonese)
- Source: https://zh-yue.wikipedia.org
- Type: Crawled text
- Format: JSON Lines (JSONL)
- Criteria: Focus on long sentences
Licensing and Permissions
This dataset is derived from Wikipedia content. Please ensure compliance with Wikipedia's licensing and terms of use, particularly the Creative Commons Attribution-ShareAlike license (CC BY-SA). Proper attribution must be given for all content derived from Wikipedia. Acknowledgments
We acknowledge Wikipedia and its contributors for providing the source content for this dataset. Limitations and Considerations
- Content Variability: The dataset may contain a mix of different topics and contexts, as it is sourced from various Wikipedia articles.
- Complexity: The focus on long sentences could present challenges in parsing and processing complex structures.
- Ethical Considerations: Ensure appropriate use of the dataset in accordance with Wikipedia's licensing and any applicable data protection regulations.