datasets
Training and evaluation data, with the modality, task and licence stated up front. Listed live from the Hugging Face Hub.
cccc
Creative Commons Common Crawl
Description
This dataset contains text from 52 Common Crawl snapshots, covering about half of Common Crawl snapshots available to date and covering all years of operations of Common Crawl up to 2024.
We found a higher level of duplication across this collection, suggesting that including more snapshots would lead to a modest increase in total token yield.
From these snapshots, we extract HTML content using FastWarc.
Then, using a regular… See the full description on the dataset page: https://huggingface.co/datasets/common-pile/cccc.cccc_filtered
Creative Commons Common Crawl
Description
This dataset contains text from 52 Common Crawl snapshots, covering about half of Common Crawl snapshots available to date and covering all years of operations of Common Crawl up to 2024.
We found a higher level of duplication across this collection, suggesting that including more snapshots would lead to a modest increase in total token yield.
From these snapshots, we extract HTML content using FastWarc.
Then, using a regular… See the full description on the dataset page: https://huggingface.co/datasets/common-pile/cccc_filtered.SPaR
Dataset Card for SPaR
Data Summary
To enhance the instruction-following abilities of language models, we present SPaR, a self-play framework designed for continuous, autonomous improvement. SPaR focuses on generating high-quality preference pairs by minimizing interfering factors.
We release an SFT dataset containing 8,000 samples curated using gpt-4o-mini. In addition, we provide DPO datasets derived from llama-3-8b-instruct and mistral-7b-instruct.
Please refer to our… See the full description on the dataset page: https://huggingface.co/datasets/CCCCCC/SPaR.BPO
Dataset Card for Black-box Prompt Optimization (BPO)
Data Summary
To advance the development of alignment in language models, we introduce a black-box alignment method. BPO enhances the alignment of various Large Language Models (LLMs) with human preferences using only a plug-and-play model. To further promote alignment work from the prompting perspective, we are releasing the BPO Dataset. This dataset comprises 14,395 entries of prompt optimization pairs, constructed… See the full description on the dataset page: https://huggingface.co/datasets/CCCCCC/BPO.cccc_all_domains
🔓 Dolma 🍇 Creative Commons Common Crawl 🕸️
Subset of the Common Crawl corpus containing English documents with Creative Commons licenses.
Snapshot
Unicode Words
Documents
CC-MAIN-2013-20
3,851,018,197
5,529,294
CC-MAIN-2013-48
4,544,197,252
6,997,831
CC-MAIN-2014-10
4,429,217,941
6,682,672
CC-MAIN-2014-15
4,059,132,873
5,912,779
CC-MAIN-2014-23
5,193,195,765
8,253,690
CC-MAIN-2014-35
4,254,690,945
6,551,673
CC-MAIN-2014-41
4,289,814,449
6,558,170… See the full description on the dataset page: https://huggingface.co/datasets/nkandpa2/cccc_all_domains.