Datasetpublic

willdepueoai/parameter-golf

Parameter Golf FineWeb Export This repository hosts tokenizer-matched export artifacts derived from HuggingFaceFW/fineweb, specifically a 30B subset pulled from the 100B FineWeb cut used for parameter-golf experiments. The repository contains: pretokenized training and validation shards under datasets/datasets/ tokenizer artifacts under datasets/tokenizers/ the export manifest at datasets/manifest.json selected-document metadata at datasets/docs_selected.jsonl… See the full description on the dataset page: https://huggingface.co/datasets/willdepueoai/parameter-golf.

sourceHugging Faceodc-byupdated 6mo agoView on Hugging Face

6likes598downloads

Dataset Card

Parameter Golf FineWeb Export

This repository hosts tokenizer-matched export artifacts derived from `HuggingFaceFW/fineweb`, specifically a 30B subset pulled from the 100B FineWeb cut used for parameter-golf experiments.

The repository contains:

—pretokenized training and validation shards under datasets/datasets/
—tokenizer artifacts under datasets/tokenizers/
—the export manifest at datasets/manifest.json
—selected-document metadata at datasets/docs_selected.jsonl

License

This dataset is made available under the Open Data Commons Attribution License (ODC-By) v1.0, consistent with the upstream FineWeb dataset license.

The upstream FineWeb dataset card states that FineWeb is released under ODC-By v1.0. Use of this derived dataset is also subject to the Common Crawl Terms of Use referenced by FineWeb.

Upstream References

—FineWeb dataset: <https://huggingface.co/datasets/HuggingFaceFW/fineweb>
—ODC-By v1.0: <https://opendatacommons.org/licenses/by/1-0/>
—Common Crawl Terms of Use: <https://commoncrawl.org/terms-of-use>

Attribution

Please attribute the upstream FineWeb dataset and this derived export when redistributing or using these artifacts.