Datasetpublic

BEE-spoke-data/falcon-refinedweb-100k_en-xlong

BEE-spoke-data/falcon-refinedweb-100k_en-xlong A sample from falcon-refinedweb: more than 4096 & less than 34,000 gpt4 tiktoken tokens en only (via fasttext-langdetect) 100k samples

sourceHugging Faceodc-byupdated 9mo agoView on Hugging Face

0likes19downloads

Dataset Card

BEE-spoke-data/falcon-refinedweb-100k_en-xlong

A sample from falcon-refinedweb:

—more than 4096 & less than 34,000 gpt4 tiktoken tokens
—en only (via fasttext-langdetect)
—100k samples