Datasetpublic

asoria/dask_test

This is a test on how to upload a dataset using dask: import dask.dataframe as dd # First read from another repo or create your dataframe df = dd.read_parquet("hf://datasets/asoria/columns_test@~parquet/**/*.parquet") # And finally, push to HF repo df.to_parquet('hf://datasets/asoria/dask_test')

sourceHugging Faceupdated 2y agoView on Hugging Face

0likes30downloads

Dataset Card

This is a test on how to upload a dataset using dask:

python

import dask.dataframe as dd

# First read from another repo or create your dataframe
df = dd.read_parquet("hf://datasets/asoria/columns_test@~parquet/**/*.parquet")

# And finally, push to HF repo
df.to_parquet('hf://datasets/asoria/dask_test')