EliMC/TxT360-5M-sample-en
BEE-spoke-data/TxT360-5M-sample-en english only sample from LLM360/TxT360: min length 256 GPT-4 tokens max length 24576 GPT-4 tokens GPT-4 tiktoken token count: token_count count 5.000000e+06 mean 1.003614e+03 std 1.424231e+03 min 2.570000e+02 25% 4.020000e+02 50% 6.220000e+02 75% 1.050000e+03 max 2.457400e+04 Total count: 5018.07 M tokens
0160
../
train-00000-of-00046.parquetdownload
train-00001-of-00046.parquetdownload
train-00002-of-00046.parquetdownload
train-00003-of-00046.parquetdownload
train-00004-of-00046.parquetdownload
train-00005-of-00046.parquetdownload
train-00006-of-00046.parquetdownload
train-00007-of-00046.parquetdownload
train-00008-of-00046.parquetdownload
train-00009-of-00046.parquetdownload
train-00010-of-00046.parquetdownload
train-00011-of-00046.parquetdownload
train-00012-of-00046.parquetdownload
train-00013-of-00046.parquetdownload
train-00014-of-00046.parquetdownload
train-00015-of-00046.parquetdownload
train-00016-of-00046.parquetdownload
train-00017-of-00046.parquetdownload
train-00018-of-00046.parquetdownload
train-00019-of-00046.parquetdownload
train-00020-of-00046.parquetdownload
train-00021-of-00046.parquetdownload
train-00022-of-00046.parquetdownload
train-00023-of-00046.parquetdownload
train-00024-of-00046.parquetdownload
train-00025-of-00046.parquetdownload
train-00026-of-00046.parquetdownload
train-00027-of-00046.parquetdownload
train-00028-of-00046.parquetdownload
train-00029-of-00046.parquetdownload
train-00030-of-00046.parquetdownload
train-00031-of-00046.parquetdownload
train-00032-of-00046.parquetdownload
train-00033-of-00046.parquetdownload
train-00034-of-00046.parquetdownload
train-00035-of-00046.parquetdownload
train-00036-of-00046.parquetdownload
train-00037-of-00046.parquetdownload
train-00038-of-00046.parquetdownload
train-00039-of-00046.parquetdownload
train-00040-of-00046.parquetdownload
train-00041-of-00046.parquetdownload
train-00042-of-00046.parquetdownload
train-00043-of-00046.parquetdownload
train-00044-of-00046.parquetdownload
train-00045-of-00046.parquetdownload