BEE-spoke-data/falcon-refinedweb-100k_en-long
BEE-spoke-data/falcon-refinedweb-100k_en-long A sample from falcon-refinedweb: more than 2048 & less than 16384 gpt4 tiktoken tokens en only (via fasttext-langdetect) 100k samples
420
BEE-spoke-data/falcon-refinedweb-100k_en-long
A sample from falcon-refinedweb:
- more than 2048 & less than 16384 gpt4 tiktoken tokens
enonly (via fasttext-langdetect)- 100k samples
