lars1234/baidu-baike-dataset
Baidu Baike Dataset This dataset contains 5,634,898 entries extracted from Baidu Baike (百度百科), which is one of the largest Chinese online encyclopedias. This is a mirror of the original dataset from https://github.com/BIT-ENGD/baidu_baike, with data originally crawled around 2019. Format Each entry in the JSON format includes the following fields: title: The title of the Baidu Baike entry summary: A brief summary of the entry content sections: A list of sections… See the full description on the dataset page: https://huggingface.co/datasets/lars1234/baidu-baike-dataset.
Baidu Baike Dataset
This dataset contains 5,634,898 entries extracted from Baidu Baike (百度百科), which is one of the largest Chinese online encyclopedias. This is a mirror of the original dataset from https://github.com/BIT-ENGD/baidu_baike, with data originally crawled around 2019.
Format
Each entry in the JSON format includes the following fields:
title: The title of the Baidu Baike entrysummary: A brief summary of the entry contentsections: A list of sections, where each section contains atitleandcontenttags: Categories or labels associated with the entryurl: The original Baidu Baike URL for the entry
License and Usage Restrictions
This dataset provides a mirror of the Baidu Baike dataset originally created by Beijing Institute of Technology (BIT-ENGD). The dataset is made available for research purposes only. All rights to the original data belong to Baidu Baike. The maintainer of this mirror makes no warranties regarding the dataset and disclaims all liability for damages resulting from its use. By accessing or using this dataset, you agree to use it solely for non-commercial research purposes, not redistribute it without permission from the original rights holders, properly cite the original dataset creators in any publications, and not hold the mirror maintainer liable for any issues arising from its use. Any commercial use requires explicit permission from the original rights holders.