datasets
Training and evaluation data, with the modality, task and licence stated up front. Listed live from the Hugging Face Hub.
TwitterHjerneRetrieval
TwitterHjerneRetrieval
An MTEB dataset
Massive Text Embedding Benchmark
Danish question asked on Twitter with the Hashtag #Twitterhjerne ('Twitter brain') and their corresponding answer.
Task category
t2t
Domains
Social, Written
Reference
https://huggingface.co/datasets/sorenmulli/da-hashtag-twitterhjerne
How to evaluate on this task
You can evaluate an embedding model on this dataset using the following code:
import mteb
task =… See the full description on the dataset page: https://huggingface.co/datasets/mteb/TwitterHjerneRetrieval.twittersemeval2015-pairclassification
TwitterSemEval2015
An MTEB dataset
Massive Text Embedding Benchmark
Paraphrase-Pairs of Tweets from the SemEval 2015 workshop.
Task category
t2t
Domains
Social, Written
Reference
https://alt.qcri.org/semeval2015/task1/
How to evaluate on this task
You can evaluate an embedding model on this dataset using the following code:
import mteb
task = mteb.get_tasks(["TwitterSemEval2015"])
evaluator = mteb.MTEB(task)
model = mteb.get_model(YOUR_MODEL)… See the full description on the dataset page: https://huggingface.co/datasets/mteb/twittersemeval2015-pairclassification.twitter100m_tweets
Dataset Card for "twitter100m_tweets"
Dataset with tweets for this post.
DOI: 10.5281/zenodo.15086029
da-hashtag-twitterhjerne
Dataset Card for "da-hashtag-twitterhjerne"
Danish questions asked on Twitter using the Hashtag "#Twitterhjerne" ('Twitter brain') and their answers.
For each question tweet 2-6 answer tweets are included.
Further details can be found in Section 4.2.3 in the thesis.
Produced by: Søren Vejlgaard Holm under supervision of Lars Kai Hansen and Martin Carsten Nielsen.
Usable for: Question Answering Evaluation.
Contact: Søren Vejlgaard Holm at swiho@dtu.dk or swh@alvenir.ai.
customer-support-on-twitter-conversationArabic_Sentiment_Twitter_Corpus
Dataset Card for [Dataset Name]
Dataset Summary
[More Information Needed]
Supported Tasks and Leaderboards
[More Information Needed]
Languages
[More Information Needed]
Dataset Structure
Data Instances
[More Information Needed]
Data Fields
[More Information Needed]
Data Splits
[More Information Needed]
Dataset Creation
Curation Rationale
[More Information Needed]
Source Data… See the full description on the dataset page: https://huggingface.co/datasets/arbml/Arabic_Sentiment_Twitter_Corpus.Arabic_Sentiment_Twitter_Corpus
Dataset Card for "Arabic_Sentiment_Twitter_Corpus"
Source:
https://www.kaggle.com/datasets/mksaad/arabic-sentiment-twitter-corpus
ajgt_twitter_ar
Dataset Card for Arabic Jordanian General Tweets
Dataset Summary
Arabic Jordanian General Tweets (AJGT) Corpus consisted of 1,800 tweets annotated as positive and negative. Modern Standard Arabic (MSA) or Jordanian dialect.
Supported Tasks and Leaderboards
The dataset was published on this paper.
Languages
The dataset is based on Arabic.
Dataset Structure
Data Instances
A binary datset with with negative and positive… See the full description on the dataset page: https://huggingface.co/datasets/komari6/ajgt_twitter_ar.Customer_Support_on_Twittertwitter-year-splits
Dataset Card for "twitter-year-splits"
More Information needed
climate_twitter_text_embeddingsTwitter_AI
VISUAL COUNTER TURING TEST (VCT²) — TWITTER DATASET
The Visual Counter Turing Test (VCT²) dataset is introduced in the paper“Visual Counter Turing Test (VCT²): Discovering the Challenges for AI-Generated Image Detection and Introducing Visual AI Index (V_AI)”,accepted at IJCNLP–AACL 2025 and available on arXiv:2411.16754.
This dataset aims to benchmark and analyze the challenges of AI-generated image detection (AGID) using real-world, social media–driven captions and imagery.It… See the full description on the dataset page: https://huggingface.co/datasets/NasrinImp/Twitter_AI.task512_twitter_emotion_classification
Dataset Card for Natural Instructions (https://github.com/allenai/natural-instructions) Task: task512_twitter_emotion_classification
Additional Information
Citation Information
The following paper introduces the corpus in detail. If you use the corpus in published work, please cite it:
@misc{wang2022supernaturalinstructionsgeneralizationdeclarativeinstructions,
title={Super-NaturalInstructions: Generalization via Declarative Instructions on 1600+ NLP… See the full description on the dataset page: https://huggingface.co/datasets/Lots-of-LoRAs/task512_twitter_emotion_classification.TwitterMemes
Dataset Card for Twitter Image Dataset
Dataset Description
Dataset Summary
This dataset contains images scraped from Twitter along with associated metadata. The dataset is intended for research purposes, focusing on image analysis, natural language processing, and social media dynamics studies.
Supported Tasks and Leaderboards
The dataset can be used for tasks such as image recognition, sentiment analysis, text extraction from images (OCR), and… See the full description on the dataset page: https://huggingface.co/datasets/HSDSLab/TwitterMemes.twitter_AIItwitter_dataset_2customer-support-twitter-datasettwitter_customer_support_weaviate_export_200000_text-embedding-3-smallNER_Twitter_Col_model_toLowerCasetwitter-financial-news-sentimentzeroshot/twitter-financial-news-sentiment prepared for LLM fine-tuning
by adding an instruction column and mapping the label from numeric to string ({0:"negative", 1:'positive', 2:'neutral'}).
Source
from datasets import load_dataset
import datasets
from huggingface_hub import notebook_login
notebook_login()
ds = load_dataset('zeroshot/twitter-financial-news-sentiment')
num_to_label = {
0: 'negative',
1: 'positive',
2: 'neutral',
}
instruction = 'What is the sentiment of this… See the full description on the dataset page: https://huggingface.co/datasets/jppgks/twitter-financial-news-sentiment.TwitterAAEtwitter-parsemultilingual-twitter-collective-violence-dataset
Dataset Card for Multilingual Twitter Dataset for Collective Violence Detection
This dataset links over 23 million multilingual tweets to a georeferenced database of collective violence events derived from the Uppsala Conflict Data Program (UCDP). It is designed for training and evaluating models that detect early indicators of organized violence in social media. Each tweet is labeled using a spatio-temporal heuristic across 40 multilabel indicators, specifying whether the tweet… See the full description on the dataset page: https://huggingface.co/datasets/m2im/multilingual-twitter-collective-violence-dataset.twitter_customer_support_weaviate_export_200000_nomic-embed-texttwittersemeval2015-pairclassification_CS-MTEB
TwitterSemEval2015 CS-MTEB
Code-switching version of mteb/twittersemeval2015-pairclassification, with sentence pairs rewritten in Chinese-English, Japanese-English, German-English, Spanish-English, Korean-English, French-English, Italian-English, Portuguese-English, Dutch-English code-switching styles.
Dataset Structure
From original dataset (unchanged):
default: Original test split (batched format)
Code-switching test sets (flat format):
test_zh_en: Chinese-English… See the full description on the dataset page: https://huggingface.co/datasets/UTokyo-Yokoya-Lab/twittersemeval2015-pairclassification_CS-MTEB.twitterDataset used in the paper:
A thorough benchmark of automatic text classification
From traditional approaches to large language models
https://github.com/waashk/atcBench
To guarantee the reproducibility of the obtained results, the dataset and its respective CV train-test partitions is available here.
Each dataset contains the following files:
data.parquet: pandas DataFrame with texts and associated encoded labels for each document.
split_<k>.pkl: pandas DataFrame with k-cross validation… See the full description on the dataset page: https://huggingface.co/datasets/waashk/twitter.historical-twitter-trends-spanish-locations-2020-2021
Historical Twitter Trends Across 11 Spanish-Speaking Locations (2020–2021)
Dataset summary
This dataset contains 5,726,446 historical observations of trending topics displayed by TweetDeck across 11 Spanish-speaking countries and territories. The observations cover the period from July 15, 2020, to September 22, 2021.
The collection software was configured to run every 15 minutes and recorded the trend text, its position in the TweetDeck trends column, the… See the full description on the dataset page: https://huggingface.co/datasets/soncco/historical-twitter-trends-spanish-locations-2020-2021.NER_Twitter_Col_model_uncleanedtwitter-sentiment-analysis
Twitter Sentiment Analysis: Prabowo's First 100 Days
Dataset Overview
This dataset contains tweets related to President Prabowo Subianto's first 100 days in office in Indonesia (2024-2029). The tweets have been preprocessed and classified into three sentiment categories using a fine-tuned BERT model for Indonesian language (IndoBERT).
Dataset Details
Language: Indonesian
Source: Twitter/X
Time period: First 100 days of President Prabowo's… See the full description on the dataset page: https://huggingface.co/datasets/KidzRizal/twitter-sentiment-analysis.nlp_twitter_analysis