datasets
Training and evaluation data, with the modality, task and licence stated up front. Listed live from the Hugging Face Hub.
machinelearninglm-scm-synthetic-tabularml
MachineLearningLM Pretraining Corpus
This repository contains the pretraining corpus for MachineLearningLM, a framework designed to equip large language models (LLMs) with robust in-context machine learning (ML) capabilities. The dataset consists of ML tasks synthesized from millions of structural causal models (SCMs), spanning various shot counts up to 1,024. It is designed to enable LLMs to learn from many in-context examples on standard ML tasks purely via in-context learning… See the full description on the dataset page: https://huggingface.co/datasets/MachineLearningLM/machinelearninglm-scm-synthetic-tabularml.seedance_general_all_dance_scm_latent_lmdb
Seedance General-All + Dance SCM Latent LMDB
This dataset stores precomputed SCM latents used for TurboT2AV training.
Source mapping: seedance_general_all_dance_mapping.csv
Successful latent samples: 44,305
Shards: 8 LMDB shards under scm_latent_lmdb/shard_00000 ... shard_00007
Video latent shape per sample: (1, 16, 128, 16, 24)
Audio latent shape per sample: (1, 127, 128)
The source mapping combines Seedance general-all data with a dance subset. The mapping contains 44,504… See the full description on the dataset page: https://huggingface.co/datasets/luyu1021/seedance_general_all_dance_scm_latent_lmdb.ViQP
ViQP: Dataset for Vietnamese Question Paraphrasing
Dataset sample
An example of 'viqp_train.json' looks as follows.
{
"source": "Trong thuật toán Caesar Cipher, ký tự K với mã hóa k=4 thì sẽ được chữ mới gì?",
"target": [
"Ký tự K với mã hóa k=4 trong thuật toán Caesar Cipher thì sẽ được chữ gì?",
"Ký tự K với mã hóa k=4 trong thuật toán Caesar Cipher thì sẽ được chữ mới gì?",
"Trong thuật toán Caesar Cipher, ký tự K với mã hóa k=4 thì sẽ được… See the full description on the dataset page: https://huggingface.co/datasets/SCM-LAB/ViQP.legal-scmlwm-spectro-scmax-heldoutViQP-segmentlwm-spectro-scmaxscm_finetuning1