datasets
Training and evaluation data, with the modality, task and licence stated up front. Listed live from the Hugging Face Hub.
cccc
Creative Commons Common Crawl
Description
This dataset contains text from 52 Common Crawl snapshots, covering about half of Common Crawl snapshots available to date and covering all years of operations of Common Crawl up to 2024.
We found a higher level of duplication across this collection, suggesting that including more snapshots would lead to a modest increase in total token yield.
From these snapshots, we extract HTML content using FastWarc.
Then, using a regular… See the full description on the dataset page: https://huggingface.co/datasets/common-pile/cccc.cccc_filtered
Creative Commons Common Crawl
Description
This dataset contains text from 52 Common Crawl snapshots, covering about half of Common Crawl snapshots available to date and covering all years of operations of Common Crawl up to 2024.
We found a higher level of duplication across this collection, suggesting that including more snapshots would lead to a modest increase in total token yield.
From these snapshots, we extract HTML content using FastWarc.
Then, using a regular… See the full description on the dataset page: https://huggingface.co/datasets/common-pile/cccc_filtered.VPO
Dataset Card for VPO
Data Summary
To bridge the gap between training and inference in video generation models, we present VPO—a principle-driven framework designed to generate harmless, accurate, and helpful prompts for high-quality video generation.
We release an SFT dataset containing 10k samples constructed using gpt-4o. In addition, we provide the DPO datasets derived from CogVideoX-2B and CogVideoX-5B.
Please refer to our paper for further details.… See the full description on the dataset page: https://huggingface.co/datasets/CCCCCC/VPO.SPaR
Dataset Card for SPaR
Data Summary
To enhance the instruction-following abilities of language models, we present SPaR, a self-play framework designed for continuous, autonomous improvement. SPaR focuses on generating high-quality preference pairs by minimizing interfering factors.
We release an SFT dataset containing 8,000 samples curated using gpt-4o-mini. In addition, we provide DPO datasets derived from llama-3-8b-instruct and mistral-7b-instruct.
Please refer to our… See the full description on the dataset page: https://huggingface.co/datasets/CCCCCC/SPaR.20260526_repro_pkg
repro_pkg — portable trajectory reproducer
Self-contained package to compute the same (iter, cos_eff, E_phi, E_perp, p_phi)
trajectory as report_full2/data/trajectory_dir_energy.csv, for a new
optimizer's HF checkpoint sequence, on any machine with python + torch.
What's inside
repro_pkg/
reproduce.py standalone trajectory script (no project deps)
build_pkg.py how this package was built (kept for reference)
example_manifest.json… See the full description on the dataset page: https://huggingface.co/datasets/CCCCCyx/20260526_repro_pkg.BPO
Dataset Card for Black-box Prompt Optimization (BPO)
Data Summary
To advance the development of alignment in language models, we introduce a black-box alignment method. BPO enhances the alignment of various Large Language Models (LLMs) with human preferences using only a plug-and-play model. To further promote alignment work from the prompting perspective, we are releasing the BPO Dataset. This dataset comprises 14,395 entries of prompt optimization pairs, constructed… See the full description on the dataset page: https://huggingface.co/datasets/CCCCCC/BPO.20260515_320260515profiling-filtered-datarestaurant2SandThink