datasets
Training and evaluation data, with the modality, task and licence stated up front. Listed live from the Hugging Face Hub.
gemstones_data_order_sequentialGemstones Training Dataset - Sequential version
This data is a reprocessed version of the first 1B rows of the Dolma v1.7 dataset (https://huggingface.co/datasets/allenai/dolma).
The data is encoded using the Pythia tokenizer: https://huggingface.co/EleutherAI/pythia-160m
Disclaimer: this is an approximation of the dataset used to train the Gemstones model suite.
Due to the randomized and sharded nature of the distributed training code, the only way to perfectly
reproduce the training batches… See the full description on the dataset page: https://huggingface.co/datasets/tomg-group-umd/gemstones_data_order_sequential.sequential-boltzmann-generators-data
Sequential Boltzmann Generators Data
This repository contains the data used in the work Scalable Equilibrium Sampling with Sequential Boltzmann Generators ICML 2025
This data is a mixture of novel trajectories for our work, as well as existing trajectories that have been reformatted for ease of use with our codebase.
The sources of each dataset are as follows:
Ace-A-Nme_300K Smooth Normalizing Flows
AAA_310K Scalable Equilibrium Sampling with Sequential Boltzmann Generators (Ours)… See the full description on the dataset page: https://huggingface.co/datasets/transferable-samplers/sequential-boltzmann-generators-data.ESdB-Embeddings-for-Sequential-data-Benchmark
ESdB: Embeddings for Sequential Data Benchmark
ESdB provides reproducible splits, evaluation shifts, and downstream targets
for benchmarking representations of sequential data.
This repository contains benchmark annotations only. It does not redistribute
the original events or input features. Original datasets must be obtained from
their respective sources and can be reproduced with the preprocessing code in
the ESdB repository.
Structure
Each dataset contains… See the full description on the dataset page: https://huggingface.co/datasets/On-Point-Rnd/ESdB-Embeddings-for-Sequential-data-Benchmark.Llada2_EB_Decode_512_sequential_datasetdolphin-llama3-8b-sequential-backdoor-3-IHY-datasetdolphin-llama3-8b-sequential-backdoor-8-IHY-datasetdolphin-llama3-8b-sequential-backdoor-4-IHY-dataset-distilleddolphin-llama3-8b-sequential-backdoor-2-IHY-dataset-distilleddolphin-llama3-8b-sequential-backdoor-5-IHY-dataset-distilleddolphin-llama3-8b-sequential-backdoor-9-IHY-datasetdolphin-llama3-8b-sequential-backdoor-4-IHY-datasetdolphin-llama3-8b-sequential-backdoor-10-IHY-datasetcombined_legal_datasets_sequentialdolphin-llama3-8b-sequential-5-backdoor-IHY-datasetdolphin-llama3-8b-sequential-backdoor-3-IHY-dataset-distilleddolphin-llama3-8b-sequential-backdoor-6-IHY-datasetESdB-Embeddings-for-Sequential-data-Benchmarkdolphin-llama3-8b-sequential-backdoor-1-IHY-datasetdolphin-llama3-8b-sequential-backdoor-2-IHY-datasetdolphin-llama3-8b-sequential-backdoor-5-IHY-datasetdolphin-llama3-8b-sequential-backdoor-1-IHY-dataset-distilledsequential-behavioral-malware-datasetdolphin-llama3-8b-sequential-backdoor-7-IHY-datasetItem_Sequential_datasetItem_Sequential_3_category_datasetItem_Negative_Sequential_dataset