huggingface/datatrove-tests
Datasets used for datatrove testing. Each split contains the same data: dst = [ {"text": "hello"}, {"text": "world"}, {"text": "how"}, {"text": "are"}, {"text": "you"}, ] But based on the split name the data are sharded into n-bins
08.9k
Datasets used for datatrove testing. Each split contains the same data:
dst = [
{"text": "hello"},
{"text": "world"},
{"text": "how"},
{"text": "are"},
{"text": "you"},
]But based on the split name the data are sharded into n-bins
