Query-of-CC/Knowledge_Pile

Knowledge Pile is a knowledge-related data leveraging Query of CC. This dataset is a partial of Knowledge Pile(about 40GB disk size), full datasets have been released in [🤗 knowledge_pile_full], a total of 735GB disk size and 188B tokens (using Llama2 tokenizer). Query of CC Just like the figure below, we initially collected seed information in some specific domains, such as keywords, frequently asked questions, and textbooks, to serve as inputs for the Query Bootstrapping… See the full description on the dataset page: https://huggingface.co/datasets/Query-of-CC/Knowledge_Pile.