cleanlab
Datasets
All datasets matching “cleanlab”FinQA-hallucination-detection
FinQA Hallucination Detection
Dataset Summary
This dataset was created from a subset of the original FinQA dataset. For each user query (financial questions), we prompted an LLM to generate a response to this query based on provided context (financial statements and tables from the original FinQA).
Each generated LLM response is labeled based on whether it is correct or not. This dataset is thus useful for benchmarking reference-free LLM Eval and Hallucination… See the full description on the dataset page: https://huggingface.co/datasets/Cleanlab/FinQA-hallucination-detection.insurance-claims-extractionThis dataset can be used for benchmarking LLM Structured Outputs via the code here:
https://github.com/cleanlab/structured-output-benchmark/
stanford-politeness
Stanford Politeness Dataset
This dataset contains politeness classification data based on the Stanford Politeness Corpus for active learning and fine-tuning tasks.
Dataset Description
The dataset is organized into two main directories:
Active Learning
X_labeled_full.csv - Labeled examples
X_unlabeled.csv - Unlabeled examples for active learning
extra_annotations.npy - Additional annotation data
test.csv - Test set
Fine-tuning
train.csv - Training… See the full description on the dataset page: https://huggingface.co/datasets/Cleanlab/stanford-politeness.fire-financial-ner-extractionThis dataset can be used for benchmarking LLM Structured Outputs via the code here:
https://github.com/cleanlab/structured-output-benchmark/
amazon-reviews
Amazon Reviews Dataset
This dataset contains Amazon product reviews with binary sentiment labels (positive, negative) for text classification tasks.
Dataset Description
The dataset includes:
train.csv - Training set, 5000 samples
test.csv - Test set, 1000 samples
Usage
import pandas as pd
from huggingface_hub import hf_hub_download
# Download the training set
file_path = hf_hub_download(
repo_id="Cleanlab/amazon-reviews",
filename="train.csv"… See the full description on the dataset page: https://huggingface.co/datasets/Cleanlab/amazon-reviews.pii-extractionThis dataset can be used for benchmarking LLM Structured Outputs via the code here:
https://github.com/cleanlab/structured-output-benchmark/