CoolFace
30 shown

datasets

Training and evaluation data, with the modality, task and licence stated up front. Listed live from the Hugging Face Hub.

Clear all
01cskokgibbs /yeast-no-GTL-pretokenized-NT-v2tabular1M<n<10M0 likes414 downloads1y agoHugging Face02cskokgibbs /mouse-pretokenized-NTtabular100K<n<1M0 likes310 downloads2y agoHugging Face03cskokgibbs /human-pretokenized-NTtabular1M<n<10M0 likes304 downloads2y agoHugging Face04cskokgibbs /yeast-gene-sequence-homology-pretokenized-NTtabular1M<n<10M0 likes274 downloads1y agoHugging Face05ZhuofengLi /fineweb-edu-pretokenized-llama3-100b FineWeb-Edu Pretokenized with Llama 3.1 (100B) This repository contains the sample/100BT subset of FineWeb-Edu, pretokenized for Megatron-LM-style training with meta-llama/Meta-Llama-3.1-8B. It is a derived, pretokenized version of the upstream data, not an official Hugging Face FineWeb release. Dataset summary 140 indexed shards 97,270,686 non-empty documents 97,458,793,013 tokens English web text from FineWeb-Edu sample/100BT Source dataset revision:… See the full description on the dataset page: https://huggingface.co/datasets/ZhuofengLi/fineweb-edu-pretokenized-llama3-100b.tabularn<1K0 likes261 downloads2mo agoHugging Face06cskokgibbs /yeast-no-label-pretokenized-NTtabular1M<n<10M0 likes242 downloads1y agoHugging Face07cskokgibbs /human_and_mouse-pretokenized-NTtabular1M<n<10M0 likes239 downloads2y agoHugging Face08cskokgibbs /BEELINE-HepG2-no-GTL-pretokenized-NTtabular1M<n<10M0 likes224 downloads1y agoHugging Face09cskokgibbs /BEELINE-mDC-no-label-pretokenized-NTtabular1M<n<10M0 likes223 downloads1y agoHugging Face10cskokgibbs /BEELINE-human-v2-pretokenized-NTtabular10M<n<100M0 likes211 downloads1y agoHugging Face11cskokgibbs /BEELINE-mouse-v2-pretokenized-NTtabular1M<n<10M0 likes211 downloads1y agoHugging Face12cskokgibbs /BEELINE-mESC-no-label-pretokenized-NTtabular1M<n<10M0 likes202 downloads1y agoHugging Face13cskokgibbs /BEELINE-mHSC-no-label-pretokenized-NTtabular1M<n<10M0 likes188 downloads1y agoHugging Face14ZhuofengLi /pretraining-pretokenized-smollm3 SmolLM3 Pretokenized Pretraining Sources Datatrove/Nanotron tokenized-byte versions of three public pretraining sources: fineweb-edu-10bt: HuggingFaceFW/fineweb-edu, sample/10BT finemath-4plus: HuggingFaceTB/finemath, finemath-4plus stack-edu-python: HuggingFaceTB/stack-edu, Python, with content retrieved from the public Software Heritage S3 bucket using the upstream dataset-card procedure All subsets use HuggingFaceTB/SmolLM3-3B at revision… See the full description on the dataset page: https://huggingface.co/datasets/ZhuofengLi/pretraining-pretokenized-smollm3.tabularn<1K0 likes161 downloads2mo agoHugging Face15cskokgibbs /BEELINE-hESC-no-GTL-pretokenized-NTtabular1M<n<10M0 likes135 downloads1y agoHugging Face16cskokgibbs /BEELINE-mDC-no-GTL-pretokenized-NTtabular1M<n<10M0 likes133 downloads1y agoHugging Face17ZhuofengLi /fineweb-edu-pretokenized-10b FineWeb-Edu Pretokenized 10B Megatron indexed-dataset (.bin/.idx) versions of HuggingFaceFW/fineweb-edu sample/10BT. Each Hugging Face subset contains a small metadata.parquet index. The actual Megatron files are under <subset>/files/; pass each prefix without the .bin/.idx suffix to Megatron Core or Megatron Bridge. Documents retain upstream shard and row order. Tokenization disables automatic special-token insertion and appends exactly one tokenizer EOS/EOD token to each… See the full description on the dataset page: https://huggingface.co/datasets/ZhuofengLi/fineweb-edu-pretokenized-10b.tabularn<1K0 likes108 downloads2mo agoHugging Face18cskokgibbs /yeast-tf-sequence-homology-pretokenized-NTtabular1M<n<10M0 likes77 downloads1y agoHugging Face19cskokgibbs /BEELINE-mESC-no-GTL-pretokenized-NTtabular100K<n<1M0 likes71 downloads1y agoHugging Face20cskokgibbs /BEELINE-HepG2-no-label-pretokenized-NTtabular100K<n<1M0 likes67 downloads1y agoHugging Face21cskokgibbs /BEELINE-hESC-no-label-pretokenized-NTtabular100K<n<1M0 likes67 downloads1y agoHugging Face22joey00072 /pretokenized__HuggingFaceFW_fineweb-edu__EleutherAI__gpt-neo-125mtabular1M<n<10M0 likes59 downloads2y agoHugging Face23cskokgibbs /BEELINE-mHSC-no-GTL-pretokenized-NTtabular100K<n<1M0 likes39 downloads1y agoHugging Face24cskokgibbs /multi_species-pretokenized-NTtabular100K<n<1M0 likes33 downloads2y agoHugging Face25cskokgibbs /BEELINE-human-pretokenized-NTtabular100K<n<1M0 likes27 downloads1y agoHugging Face26cskokgibbs /BEELINE-mouse-pretokenized-NTtabular100K<n<1M0 likes20 downloads1y agoHugging Face27cskokgibbs /pretokenized_gold_standardtabular100K<n<1M0 likes15 downloads2y agoHugging Face28cskokgibbs /yeast-promoters-noGTL-pretokenized-NTtabular1M<n<10M0 likes14 downloads1y agoHugging Face29cskokgibbs /human_and_mouse_2-pretokenized-NTtabular100K<n<1M0 likes10 downloads1y agoHugging Face30felix-ai-alt /pretokenized__HuggingFaceFW_fineweb-edu__EleutherAI__gpt-neo-125mtabular1M<n<10M0 likes9 downloads2y agoHugging Face

Listings come live from the Hugging Face Hub API. CoolFace does not host these files.