datasets
Training and evaluation data, with the modality, task and licence stated up front. Listed live from the Hugging Face Hub.
OpenDebateEvidence-Deduplicated-Anonymized
Dataset Card for OpenDebateEvidence-Deduplicated (Anonymized)
Debate evidence from collegiate and high school competitions, semantically
deduplicated, with all debater-identifying columns removed.
This is the semantically deduplicated companion to
OpenDebateEvidence-Anonymized.
Where the parent dataset contains every piece of evidence as used in every round,
this version collapses repeated use of the same evidence into single records,
making it substantially smaller and better… See the full description on the dataset page: https://huggingface.co/datasets/Hellisotherpeople/OpenDebateEvidence-Deduplicated-Anonymized.nl2sql-deduplicated
NL2SQL Deduplicated Training Dataset
A curated and deduplicated Text-to-SQL training dataset with 683,015 unique examples from 4 high-quality sources.
📊 Dataset Summary
Total Examples: 683,015 unique question-SQL pairs
Sources: Spider, SQaLe, Gretel Synthetic, SQL-Create-Context
Deduplication Strategy: Input-only (question-based) with conflict resolution via quality priority
Conflicts Resolved: 2,238 cases where same question had different SQL
SQL Dialect: Standard SQL… See the full description on the dataset page: https://huggingface.co/datasets/AsadIsmail/nl2sql-deduplicated.ngxson_MiniThinky_v1_deduplicated_11_percentClustering_deduplicated_reasoning
Clustering_deduplicated_reasoning
数据集描述
Clustering deduplicated reasoning data filtered from OpenThoughts2-1M, 77662 examples in total, 10000 examples for each category
文件结构
clustering_deduplicated_reasoning_data_english.jsonl: 主数据文件（JSONL格式）
数据格式
数据集包含以下字段：
question: str
quality: int
difficulty: int
topic: str
validity: int
使用方法
方法1: 使用datasets库
from datasets import load_dataset
# 加载数据集
dataset =… See the full description on the dataset page: https://huggingface.co/datasets/Ibisbill/Clustering_deduplicated_reasoning.Semantic_similarity_deduplicated_reasoning_data_english
Semantic_similarity_deduplicated_reasoning_data_english
数据集描述
Semantic similarity deduplicated reasoning data filtered from OpenThoughts2-1M, 77662 examples in total, 10000 examples for each category
文件结构
semantic_similarity_deduplicated_reasoning_data_english.jsonl: 主数据文件（JSONL格式）
数据格式
数据集包含以下字段：
question: str
quality: int
difficulty: int
topic: str
validity: int
使用方法
方法1: 使用datasets库
from datasets import load_dataset
#… See the full description on the dataset page: https://huggingface.co/datasets/Ibisbill/Semantic_similarity_deduplicated_reasoning_data_english.hash_deduplicated_reasoning_data_english
hash_deduplicated_reasoning_data_english
数据集描述
Hash deduplicated reasoning data filtered from OpenThoughts2-1M, 72710 examples in total
文件结构
hash_deduplicated_reasoning_data_english.jsonl: 主数据文件（JSONL格式）
数据格式
数据集包含以下字段：
question: str
quality: int
difficulty: int
topic: str
validity: int
使用方法
方法1: 使用datasets库
from datasets import load_dataset
# 加载数据集
dataset = load_dataset("Ibisbill/hash_deduplicated_reasoning_data_english")… See the full description on the dataset page: https://huggingface.co/datasets/Ibisbill/hash_deduplicated_reasoning_data_english.