datasets
Training and evaluation data, with the modality, task and licence stated up front. Listed live from the Hugging Face Hub.
real-toxicity-prompts
Dataset Card for Real Toxicity Prompts
Dataset Summary
RealToxicityPrompts is a dataset of 100k sentence snippets from the web for researchers to further address the risk of neural toxic degeneration in models.
Languages
English
Dataset Structure
Data Instances
Each instance represents a prompt and its metadata:
{
"filename":"0766186-bc7f2a64cb271f5f56cf6f25570cd9ed.txt",
"begin":340,
"end":564,
"challenging":false… See the full description on the dataset page: https://huggingface.co/datasets/allenai/real-toxicity-prompts.ToxiCN
Facilitating Fine-grained Detection of Chinese Toxic Language: Hierarchical Taxonomy, Resources, and Benchmark
🎉2024.9 Our related study, titled "Towards Comprehensive Detection of Chinese Harmful Meme", has been accepted to NeurIPS 2024! In this paper, we present ToxiCN_MM, the first Chinese harmful meme dataset. Here is the link: https://github.com/DUT-lujunyu/ToxiCN_MM. Welcome to star or fork it!
🎉2024.9 Our related study, titled "PclGPT: A Large Language Model for Patronizing… See the full description on the dataset page: https://huggingface.co/datasets/JunyuLu/ToxiCN.PleIAs-ToxicCommons
PleIAs/ToxicCommons
This dataset is a refined version of the PleIAs/ToxicCommons collection, focusing on historical texts labeled for content that may be considered objectionable by modern standards (what the authors of the dataset deem "toxic").
The cleaned dataset contains 1 051 027 rows, each representing a text sample with associated toxicity scores across five dimensions:
Race and origin-based bias
Gender and sexuality-based bias
Religious bias
Ability bias
Violence and abuse… See the full description on the dataset page: https://huggingface.co/datasets/agentlans/PleIAs-ToxicCommons.filtered_toxic_samplestoxic-sk
ToxicSK
Author: Zuzana Sokolová
Corpus of toxic speech in social networks
The dataset contains 8 840 manually annotated comments from Facebook. Specifically, it includes:
4 420 comments labeled as "toxic" (value 1)
4 420 comments labeled as "non-toxic" (value 0)
The comments were annotated by a group of PhD students and assistant professors from the Technical University of Košice. The annotators' native language is Slovak. Each comment was annotated only once, and the labeling is… See the full description on the dataset page: https://huggingface.co/datasets/TUKE-KEMT/toxic-sk.jigsaw_toxicity_pred_fi
Dataset Summary
This dataset is a DeepL -based machine translated version of the Jigsaw toxicity dataset for Finnish. The dataset is originally from a Kaggle competition https://www.kaggle.com/c/jigsaw-toxic-comment-classification-challenge/data.
The dataset poses a multi-label text classification problem and includes the labels identity_attack, insult, obscene, severe_toxicity, threat and toxicity.
Example data
{
"label_identity_attack": 0,
"label_insult": 0… See the full description on the dataset page: https://huggingface.co/datasets/TurkuNLP/jigsaw_toxicity_pred_fi.real-toxicity-prompts
Dataset Card for Real Toxicity Prompts
Dataset Summary
RealToxicityPrompts is a dataset of 100k sentence snippets from the web for researchers to further address the risk of neural toxic degeneration in models.
Languages
English
Dataset Structure
Data Instances
Each instance represents a prompt and its metadata:
{
"filename":"0766186-bc7f2a64cb271f5f56cf6f25570cd9ed.txt",
"begin":340,
"end":564,
"challenging":false… See the full description on the dataset page: https://huggingface.co/datasets/krishna1707/real-toxicity-prompts.toxic-storyfrom datasets import load_dataset
model_name, beta, length = 'EleutherAI/gpt-neo-1.3B', '0.0', '20'
ds = load_dataset('cs-giung/toxic-story', data_files=f'data/{model_name}/beta{beta}-length{length}.jsonl')
real-toxicity-prompts
Dataset Card for Real Toxicity Prompts
Dataset Summary
RealToxicityPrompts is a dataset of 100k sentence snippets from the web for researchers to further address the risk of neural toxic degeneration in models.
Languages
English
Dataset Structure
Data Instances
Each instance represents a prompt and its metadata:
{
"filename":"0766186-bc7f2a64cb271f5f56cf6f25570cd9ed.txt",
"begin":340,
"end":564,
"challenging":false… See the full description on the dataset page: https://huggingface.co/datasets/ravi-softwarethreads/real-toxicity-prompts.weedmaps-jsonchallenging_toxic_samplesbunnycore__Llama-3.2-3B-ToxicKod-details
Dataset Card for Evaluation run of bunnycore/Llama-3.2-3B-ToxicKod
Dataset automatically created during the evaluation run of model bunnycore/Llama-3.2-3B-ToxicKod
The dataset is composed of 38 configuration(s), each one corresponding to one of the evaluated task.
The dataset has been created from 2 run(s). Each run can be found as a specific split in each configuration, the split being named using the timestamp of the run.The "train" split is always pointing to the latest… See the full description on the dataset page: https://huggingface.co/datasets/open-llm-leaderboard/bunnycore__Llama-3.2-3B-ToxicKod-details.ToxiCN
Facilitating Fine-grained Detection of Chinese Toxic Language: Hierarchical Taxonomy, Resources, and Benchmark
🎉2024.9 Our related study, titled "Towards Comprehensive Detection of Chinese Harmful Meme", has been accepted to NeurIPS 2024! In this paper, we present ToxiCN_MM, the first Chinese harmful meme dataset. Here is the link: https://github.com/DUT-lujunyu/ToxiCN_MM. Welcome to star or fork it!
🎉2024.9 Our related study, titled "PclGPT: A Large Language Model for Patronizing… See the full description on the dataset page: https://huggingface.co/datasets/luyaoyaotutu/ToxiCN.real-toxicity-prompts
Dataset Card for Real Toxicity Prompts
Dataset Summary
RealToxicityPrompts is a dataset of 100k sentence snippets from the web for researchers to further address the risk of neural toxic degeneration in models.
Languages
English
Dataset Structure
Data Instances
Each instance represents a prompt and its metadata:
{
"filename":"0766186-bc7f2a64cb271f5f56cf6f25570cd9ed.txt",
"begin":340,
"end":564,
"challenging":false… See the full description on the dataset page: https://huggingface.co/datasets/wangdulou/real-toxicity-prompts.sk_online_toxicityrtp-toxic-2ktoxicthesis-paraphrase-dataset
ToxicThesis Paraphrase Dataset
Tree-conditioned paraphrase dataset for training paraphrase models.
Contents
This repository contains paraphrase data with constituency tree annotations:
paraphrases.json - JSON format (23 MB, human-readable)
paraphrases.pkl - Pickle format (26 MB, faster loading)
Dataset Structure
Each example contains:
prompt: Original prompt text
paraphrase: Paraphrased version
target_tree: Constituency parse tree (simplified format)… See the full description on the dataset page: https://huggingface.co/datasets/simocorbo/toxicthesis-paraphrase-dataset.