odegiber/hate_speech18
These files contain text extracted from Stormfront, a white supremacist forum. A random set of forums posts have been sampled from several subforums and split into sentences. Those sentences have been manually labelled as containing hate speech or not, according to certain annotation guidelines.
171.1k
1---2annotations_creators:3- found4language_creators:5- found6language:7- en8license:9- cc-by-sa-3.010multilinguality:11- monolingual12size_categories:13- 10K<n<100K14source_datasets:15- original16task_categories:17- text-classification18task_ids:19- intent-classification20paperswithcode_id: hate-speech21pretty_name: Hate Speech22dataset_info:23 features:24 - name: text25 dtype: string26 - name: user_id27 dtype: int6428 - name: subforum_id29 dtype: int6430 - name: num_contexts31 dtype: int6432 - name: label33 dtype:34 class_label:35 names:36 '0': noHate37 '1': hate38 '2': idk/skip39 '3': relation40 splits:41 - name: train42 num_bytes: 137534043 num_examples: 1094444 download_size: 366453045 dataset_size: 137534046train-eval-index:47- config: default48 task: text-classification49 task_id: multi_class_classification50 splits:51 train_split: train52 col_mapping:53 text: text54 label: target55 metrics:56 - type: accuracy57 name: Accuracy58 - type: f159 name: F1 macro60 args:61 average: macro62 - type: f163 name: F1 micro64 args:65 average: micro66 - type: f167 name: F1 weighted68 args:69 average: weighted70 - type: precision71 name: Precision macro72 args:73 average: macro74 - type: precision75 name: Precision micro76 args:77 average: micro78 - type: precision79 name: Precision weighted80 args:81 average: weighted82 - type: recall83 name: Recall macro84 args:85 average: macro86 - type: recall87 name: Recall micro88 args:89 average: micro90 - type: recall91 name: Recall weighted92 args:93 average: weighted94---95 96# Dataset Card for [Dataset Name]97 98## Table of Contents99- [Dataset Description](#dataset-description)100 - [Dataset Summary](#dataset-summary)101 - [Supported Tasks and Leaderboards](#supported-tasks-and-leaderboards)102 - [Languages](#languages)103- [Dataset Structure](#dataset-structure)104 - [Data Instances](#data-instances)105 - [Data Fields](#data-fields)106 - [Data Splits](#data-splits)107- [Dataset Creation](#dataset-creation)108 - [Curation Rationale](#curation-rationale)109 - [Source Data](#source-data)110 - [Annotations](#annotations)111 - [Personal and Sensitive Information](#personal-and-sensitive-information)112- [Considerations for Using the Data](#considerations-for-using-the-data)113 - [Social Impact of Dataset](#social-impact-of-dataset)114 - [Discussion of Biases](#discussion-of-biases)115 - [Other Known Limitations](#other-known-limitations)116- [Additional Information](#additional-information)117 - [Dataset Curators](#dataset-curators)118 - [Licensing Information](#licensing-information)119 - [Citation Information](#citation-information)120 - [Contributions](#contributions)121 122## Dataset Description123 124- **Homepage:** https://github.com/Vicomtech/hate-speech-dataset125- **Repository:** https://github.com/Vicomtech/hate-speech-dataset126- **Paper:** https://www.aclweb.org/anthology/W18-51.pdf127- **Leaderboard:**128- **Point of Contact:**129 130### Dataset Summary131 132These files contain text extracted from Stormfront, a white supremacist forum. A random set of forums posts have been sampled from 133several subforums and split into sentences. Those sentences have been manually labelled as containing hate speech or not, according 134to certain annotation guidelines.135 136### Supported Tasks and Leaderboards137 138[More Information Needed]139 140### Languages141 142English143 144## Dataset Structure145 146### Data Instances147 148[More Information Needed]149 150### Data Fields151 152- text: the provided sentence153- user_id: information to make it possible to re-build the conversations these sentences belong to154- subforum_id: information to make it possible to re-build the conversations these sentences belong to155- num_contexts: number of previous posts the annotator had to read before making a decision over the category of the sentence156- label: hate, noHate, relation (sentence in the post doesn't contain hate speech on their own, but combination of serveral sentences does) 157 or idk/skip (sentences that are not written in English or that don't contain information as to be classified into hate or noHate)158 159### Data Splits160 161[More Information Needed]162 163## Dataset Creation164 165### Curation Rationale166 167[More Information Needed]168 169### Source Data170 171#### Initial Data Collection and Normalization172 173[More Information Needed]174 175#### Who are the source language producers?176 177[More Information Needed]178 179### Annotations180 181#### Annotation process182 183[More Information Needed]184 185#### Who are the annotators?186 187[More Information Needed]188 189### Personal and Sensitive Information190 191[More Information Needed]192 193## Considerations for Using the Data194 195### Social Impact of Dataset196 197[More Information Needed]198 199### Discussion of Biases200 201[More Information Needed]202 203### Other Known Limitations204 205[More Information Needed]206 207## Additional Information208 209### Dataset Curators210 211[More Information Needed]212 213### Licensing Information214 215[More Information Needed]216 217### Citation Information218 219```220@inproceedings{gibert2018hate,221 title = "{Hate Speech Dataset from a White Supremacy Forum}",222 author = "de Gibert, Ona and223 Perez, Naiara and224 Garc{\'\i}a-Pablos, Aitor and225 Cuadros, Montse",226 booktitle = "Proceedings of the 2nd Workshop on Abusive Language Online ({ALW}2)",227 month = oct,228 year = "2018",229 address = "Brussels, Belgium",230 publisher = "Association for Computational Linguistics",231 url = "https://www.aclweb.org/anthology/W18-5102",232 doi = "10.18653/v1/W18-5102",233 pages = "11--20",234}235```236 237### Contributions238 239Thanks to [@czabo](https://github.com/czabo) for adding this dataset.