Datasetpublic

toksuitebackup/facebook-xglm-564M-toksuite-detokenized

Training data of the model detokenized in the exact order seen by the model. The training data is partitioned into 8 chunks (chunk-0 through chunk-7), based on the GPU rank that generated the data. Each chunk contains detokenized text files in JSON Lines format (.jsonl).

sourceHugging Faceupdated 10mo agoView on Hugging Face

1likes350downloads

file.gitattributes4 KBdownload

fileREADME.md1 KBdownload

filetrain_data_0.00-8.jsonl20.37 GBdownload

filetrain_data_0.01-8.jsonl20.37 GBdownload

filetrain_data_0.02-8.jsonl20.36 GBdownload

filetrain_data_0.03-8.jsonl17.93 GBdownload

filetrain_data_1.00-8.jsonl20.36 GBdownload

filetrain_data_1.01-8.jsonl20.37 GBdownload

filetrain_data_1.02-8.jsonl20.38 GBdownload

filetrain_data_1.03-8.jsonl19.55 GBdownload

filetrain_data_2.00-8.jsonl20.36 GBdownload

filetrain_data_2.01-8.jsonl20.37 GBdownload

filetrain_data_2.02-8.jsonl20.37 GBdownload

filetrain_data_2.03-8.jsonl17.12 GBdownload

filetrain_data_3.00-8.jsonl20.40 GBdownload

filetrain_data_3.01-8.jsonl20.39 GBdownload

filetrain_data_3.02-8.jsonl20.38 GBdownload

filetrain_data_3.03-8.jsonl20.37 GBdownload

filetrain_data_4.00-8.jsonl20.37 GBdownload

filetrain_data_4.01-8.jsonl20.36 GBdownload

filetrain_data_4.02-8.jsonl20.37 GBdownload

filetrain_data_4.03-8.jsonl20.37 GBdownload

filetrain_data_5.00-8.jsonl20.39 GBdownload

filetrain_data_5.01-8.jsonl20.38 GBdownload

filetrain_data_5.02-8.jsonl20.38 GBdownload

filetrain_data_5.03-8.jsonl18.76 GBdownload

filetrain_data_6.00-8.jsonl20.37 GBdownload

filetrain_data_6.01-8.jsonl20.39 GBdownload

filetrain_data_6.02-8.jsonl20.38 GBdownload

filetrain_data_6.03-8.jsonl18.74 GBdownload

filetrain_data_7.00-8.jsonl20.39 GBdownload

filetrain_data_7.01-8.jsonl20.38 GBdownload

filetrain_data_7.02-8.jsonl20.38 GBdownload

filetrain_data_7.03-8.jsonl20.38 GBdownload

toksuitebackup/facebook-xglm-564M-toksuite-detokenized · main · files are served by the source, never re-hosted here