datasets
Training and evaluation data, with the modality, task and licence stated up front. Listed live from the Hugging Face Hub.
twitter-financial-news-sentiment
Dataset Description
The Twitter Financial News dataset is an English-language dataset containing an annotated corpus of finance-related tweets. This dataset is used to classify finance-related tweets for their sentiment.
The dataset holds 11,932 documents annotated with 3 labels:
sentiments = {
"LABEL_0": "Bearish",
"LABEL_1": "Bullish",
"LABEL_2": "Neutral"
}
The data was collected using the Twitter API. The current dataset supports the multi-class classification… See the full description on the dataset page: https://huggingface.co/datasets/zeroshot/twitter-financial-news-sentiment.twitter-financial-news-topic
Dataset Description
The Twitter Financial News dataset is an English-language dataset containing an annotated corpus of finance-related tweets. This dataset is used to classify finance-related tweets for their topic.
The dataset holds 21,107 documents annotated with 20 labels:
topics = {
"LABEL_0": "Analyst Update",
"LABEL_1": "Fed | Central Banks",
"LABEL_2": "Company | Product News",
"LABEL_3": "Treasuries | Corporate Debt",
"LABEL_4": "Dividend"… See the full description on the dataset page: https://huggingface.co/datasets/zeroshot/twitter-financial-news-topic.vsr_zeroshot
VSR: Visual Spatial Reasoning
This is the zero-shot set of VSR: Visual Spatial Reasoning (TACL 2023) [paper].
Usage
from datasets import load_dataset
data_files = {"train": "train.jsonl", "dev": "dev.jsonl", "test": "test.jsonl"}
dataset = load_dataset("cambridgeltl/vsr_zeroshot", data_files=data_files)
Note that the image files still need to be downloaded separately. See data/ for details.
Go to our github repo for more introductions.
Citation
If you find… See the full description on the dataset page: https://huggingface.co/datasets/cambridgeltl/vsr_zeroshot.bigbench_zero_shotZeroshot-Audio-Classification-Instructions
Zeroshot-Audio-Classification-Instructions
Convert audio classification dataset into zero-shot format speech instructions, support both single label and multi-label,
VGGSound
FSD50k
Nonspeech7k
urbansound8K
VocalSound
Emotion
Gender
ESD Emotion
Age
Language
TAU Urban Acoustic Scenes 2022
CochlScene
BirdCLEF_2021
EmoBox
AudioSet
We also converted huge WAV files into MP3 16k sample rate to reduce storage size.To prevent leakage, please do not include test set in training session.… See the full description on the dataset page: https://huggingface.co/datasets/mesolitica/Zeroshot-Audio-Classification-Instructions.PlantCAD2_zero_shot_tasks
🌱 PlantCAD2 Zero-Shot Tasks
Zero-shot evaluation tasks for plant genomics using PlantCAD2.This dataset contains tasks designed to evaluate model performance without task-specific training.
📂 Available Tasks
🔬 Cross-species Evolutionary Conservation
Task Name
Description
Samples
Metric
conservation_within_andropogoneae
Predict conserved vs non-conserved sites using alignments within 35 Andropogoneae genomes
19,030 vs 19,030
AUROC… See the full description on the dataset page: https://huggingface.co/datasets/plantcad/PlantCAD2_zero_shot_tasks.PlantCAD2_zero_shot_tasks
🌱 PlantCAD2 Zero-Shot Tasks
Zero-shot evaluation tasks for plant genomics using PlantCAD2.This dataset contains tasks designed to evaluate model performance without task-specific training.
📂 Available Tasks
🔬 Cross-species Evolutionary Conservation
Task Name
Description
Samples
Metric
conservation_within_andropogoneae
Predict conserved vs non-conserved sites using alignments within 35 Andropogoneae genomes
19,030 vs 19,030
AUROC… See the full description on the dataset page: https://huggingface.co/datasets/Yangximiao/PlantCAD2_zero_shot_tasks.synthetic_zeroshot_mixtral_v0.1ProteinGYM-DMS-zeroshotcybersecurity-corpuszero-shot-label-nlitasksource classification tasks recasted as natural language inference.
This dataset is intended to improve label understanding in zero-shot classification HF pipelines.
Inputs that are text pairs are separated by a newline (\n).
from transformers import pipeline
classifier = pipeline(model="sileod/deberta-v3-base-tasksource-nli")
classifier(
"I have a problem with my iphone that needs to be resolved asap!!",
candidate_labels=["urgent", "not urgent", "phone", "tablet", "computer"],
)… See the full description on the dataset page: https://huggingface.co/datasets/tasksource/zero-shot-label-nli.zeroshot_test_downsampledmedical-5day-zeroshotmolmoact2-so101-zero-shot-eval
MolmoAct2 SO-101 Zero-Shot Evaluation Traces
This repository contains evaluation traces from running allenai/MolmoAct2-SO100_101 zero-shot on an SO-101 robot arm using the official LeRobot MolmoAct2 integration plus a remote async inference setup.
This is an evaluation artifact, not a training dataset or model checkpoint. The model under test is AllenAI's released MolmoAct2 SO-100/SO-101 checkpoint.
Summary
MolmoAct2 remote inference was successfully brought up on… See the full description on the dataset page: https://huggingface.co/datasets/abdul004/molmoact2-so101-zero-shot-eval.autoeval-eval-autoevaluate__zero-shot-classification-sample-autoevalu-912bbb-1484454284
Dataset Card for AutoTrain Evaluator
This repository contains model predictions generated by AutoTrain for the following task and dataset:
Task: Zero-Shot Text Classification
Model: mathemakitten/opt-125m
Dataset: autoevaluate/zero-shot-classification-sample
Config: autoevaluate--zero-shot-classification-sample
Split: test
To run new evaluation jobs, visit Hugging Face's automatic model evaluator.
Contributions
Thanks to @mathemakitten for evaluating this model.
math-classification-zero-shot-resultsProteinGYM-DMS-RAG-zeroshotvsr_zeroshot_tsvarxiv-biology
Dataset Curators
The original data is maintained by ArXiv
Licensing Information
The data is under the Creative Commons CC0 1.0 Universal Public Domain Dedication
Citation Information
@misc{clement2019arxiv,
title={On the Use of ArXiv as a Dataset},
author={Colin B. Clement and Matthew Bierbaum and Kevin P. O'Keeffe and Alexander A. Alemi},
year={2019},
eprint={1905.00075},
archivePrefix={arXiv},
primaryClass={cs.IR}
}
Stack-Overflow-Zero-Shot-Classification
Dataset Card for "Stack-Overflow-Zero-Shot-Classification"
Automatic Stack Overflow Question Classifier
Important
All credit goes to huggingface user MoritzLaurer as his model is the basis for this project.
Introduction
The Automatic Stack Overflow Question Classifier harnesses the latest advancements in artificial intelligence to systematically categorize questions on Stack Overflow. Its primary goal is to streamline the process of sorting queries… See the full description on the dataset page: https://huggingface.co/datasets/amaye15/Stack-Overflow-Zero-Shot-Classification.cartesia-sonic-preview-ztts1-zero-shot-sample
Cartesia Sonic on ZTTS1 zero-shot — sample with reference audio
100 utterances per language (700 rows) from the
zero-shot subsets of ZTTS1-Eval, synthesized with Cartesia Sonic (preview) in
voice-cloning mode.
Unlike the full set, every row carries the reference recording as well as the
synthesized clip, so a take can be compared against the voice it was cloning
without checking out the benchmark.
Columns
column
meaning
audio
the clip the model produced… See the full description on the dataset page: https://huggingface.co/datasets/jaeyong2/cartesia-sonic-preview-ztts1-zero-shot-sample.medical-2day-zeroshot-freshexps-testmedical-4day-zeroshot-freshexps-test-no-contextzero_shotmedical-3day-zeroshot-freshexps-test-no-contextzero_shot_open_llm_leaderboardmedical-1day-zeroshot-freshexps-test-no-contextmultilingual-zero-shot-label-nlimtasksource classification tasks recasted as natural language inference.
This dataset is intended to improve label understanding in zero-shot classification HF pipelines.
Inputs that are text pairs are separated by a newline (\n).
from transformers import pipeline
classifier = pipeline(model="sileod/mdeberta-v3-base-tasksource-nli")
classifier(
"I have a problem with my iphone that needs to be resolved asap!!",
candidate_labels=["urgent", "not urgent", "phone", "tablet", "computer"]… See the full description on the dataset page: https://huggingface.co/datasets/tasksource/multilingual-zero-shot-label-nli.medical-1day-zeroshot-freshexps-test-no-context-llama3370binstructagain3zero-shot-emotions-8-4-1.25-85-65-75From the base score of 100, subtract 8 first for Rank 2, then subtract an additional 4 for Rank 3+. For Rank 4+, multiply the subtraction by 1.25, except for the emotions field. Next, divide by 100. Then, for each Rank, multiply this base score by Rank Number If the top original score is less than 65, then penalize all the scores by 75% of the original. If the top score is greater than 85, penalize those that are less than 65.