text-2-sql
synthetic-text2sqlEmploying the MTEB evaluation framework's dataset version, utilize the code below for assessment:
import mteb
import logging
from sentence_transformers import SentenceTransformer
from mteb import MTEB
logger = logging.getLogger(__name__)
model_name = 'intfloat/e5-base-v2'
model = SentenceTransformer(model_name)
tasks = mteb.get_tasks(
tasks=[
"AppsRetrieval",
"CodeFeedbackMT",
"CodeFeedbackST",
"CodeTransOceanContest",
"CodeTransOceanDL"… See the full description on the dataset page: https://huggingface.co/datasets/CoIR-Retrieval/synthetic-text2sql.ko_text2sqltext2sql-eval-results
Text2SQL Evaluation Toolkit — Pre-computed Results
Pre-computed inference and evaluation results produced by the
IBM/text2sql-eval-toolkit
across six text-to-SQL benchmarks.
These artefacts power the toolkit's evaluation dashboard and analysis scripts
without requiring you to re-run multi-hour inference pipelines.
Quick start
Install the toolkit and fetch all results (~3.8 GB):
pip install text2sql-eval-toolkit
text2sql-eval-toolkit results fetch
Fetch a single… See the full description on the dataset page: https://huggingface.co/datasets/text2sql-eval-toolkit/text2sql-eval-results.RBAC-Text2SQL-Benchmark
RBAC-Text2SQL Benchmark
Role-conditioned Text-to-SQL instances for evaluating whether LLMs generate SQL that
respects Role-Based Access Control (RBAC) constraints. Each instance pairs a natural
language question with a role policy; the model must either produce a correct SQL query
that touches only authorized resources, or refuse with Sorry, I cannot answer.
Code, evaluation harness, and reproduction instructions:
https://github.com/2020dfff/RBAC-Text2SQL-Benchmark… See the full description on the dataset page: https://huggingface.co/datasets/sharkiefff/RBAC-Text2SQL-Benchmark.spider-text2sql
SPIDER Text-to-SQL — Easy Access Version
A clean, HuggingFace-native version of the SPIDER Text-to-SQL benchmark. The original SPIDER dataset requires manually downloading a ZIP file from the Spider website. This version makes it instantly accessible via load_dataset.
What's Included
Each row contains the question, gold SQL, the database identifier, and a pre-parsed compact schema string — everything needed to train or evaluate a Text-to-SQL model without any additional… See the full description on the dataset page: https://huggingface.co/datasets/SuperMax991/spider-text2sql.text2sql-dataset
Dataset
We built this dataset from several sources combining examples from:
Wikisql
Bird
Spider
Synthetic SQL samples
This dataset has been cleaned and filtered by:
Removing DDL/DML examples (INSERT, UPDATE, DELETE, etc.)
De-duplicating examples based on hashing semantics of SQL and queries
Filtering only SELECT-style analytical queries