TylerHMC/maestro-tokenized

1---2dataset_info:3  features:4  - name: input_ids5    list: int326    length: 51207  - name: token_count8    dtype: int329  - name: source_file10    dtype: string11  - name: split12    dtype: string13  splits:14  - name: train15    num_bytes: 3691446816    num_examples: 178617  - name: validation18    num_bytes: 1037572119    num_examples: 50220  download_size: 4692155921  dataset_size: 4729018922configs:23- config_name: default24  data_files:25  - split: train26    path: data/train-*27  - split: validation28    path: data/validation-*29---30