mishig/parameter-golf
Parameter Golf FineWeb Export This is a Parquet-converted fork of willdepueoai/parameter-golf, reformatted for compatibility with the HuggingFace dataset viewer and the datasets library. The original repository hosts export artifacts derived from HuggingFaceFW/fineweb, specifically a ~10B-token subset pulled from the 100B FineWeb cut used for parameter-golf experiments. Dataset Structure train: 15,318,808 documents validation: 50,000 documents Each example… See the full description on the dataset page: https://huggingface.co/datasets/mishig/parameter-golf.
Parameter Golf FineWeb Export
This is a Parquet-converted fork of `willdepueoai/parameter-golf`, reformatted for compatibility with the HuggingFace dataset viewer and the datasets library.
The original repository hosts export artifacts derived from `HuggingFaceFW/fineweb`, specifically a ~10B-token subset pulled from the 100B FineWeb cut used for parameter-golf experiments.
Dataset Structure
- train: 15,318,808 documents
- validation: 50,000 documents
- Each example contains a single
textfield with the document content.
Usage
from datasets import load_dataset
ds = load_dataset("mishig/parameter-golf")License
This dataset is made available under the Open Data Commons Attribution License (ODC-By) v1.0, consistent with the upstream FineWeb dataset license.
The upstream FineWeb dataset card states that FineWeb is released under ODC-By v1.0. Use of this derived dataset is also subject to the Common Crawl Terms of Use referenced by FineWeb.
Upstream References
- Original dataset: <https://huggingface.co/datasets/willdepueoai/parameter-golf>
- FineWeb dataset: <https://huggingface.co/datasets/HuggingFaceFW/fineweb>
- ODC-By v1.0: <https://opendatacommons.org/licenses/by/1-0/>
- Common Crawl Terms of Use: <https://commoncrawl.org/terms-of-use>
Attribution
Please attribute the upstream FineWeb dataset and this derived export when redistributing or using these artifacts.