Datasetpublic

liswei/common-crawl-zhtw

Dataset Card for Common Crawl Traditional Chinese De-duplicated version of jed351/Traditional-Chinese-Common-Crawl-Filtered. De-duplicated with MinHash Is suggested to filter the dataset with NLU models before any serious use.

sourceHugging Faceupdated 2y agoView on Hugging Face

6likes184downloads

Dataset Card

Dataset Card for Common Crawl Traditional Chinese

—De-duplicated version of jed351/Traditional-Chinese-Common-Crawl-Filtered.
—De-duplicated with MinHash
—Is suggested to filter the dataset with NLU models before any serious use.