kjj0/4chanpol-openaimod

Dataset Card for "kjj0/4chanpol-openaimod"

Warning: offensive content.

This dataset contains 114M unique posts made between June 2016 and November 2019.

This is a variant of the dataset provided by Raiders of the Lost Kek: 3.5 Years of Augmented 4chan Posts from the Politically Incorrect Board. We have deduplicated posts and stripped metadata to create an easily accessible collection of unique texts.

We have also provided OpenAI moderation scores. A variant without these scores can be found at kjj0/4chanpol.

Our purpose for creating this dataset, along with the OpenAI predictions (which are fairly accurate) is to cheaply obtain a massive labeled text dataset (albeit with some unpleasant content) in order to do research on data selection, active learning, label noise, and training curricula.

@inproceedings{papasavva2020raiders,
  title={Raiders of the lost kek: 3.5 years of augmented 4chan posts from the politically incorrect board},
  author={Papasavva, Antonis and Zannettou, Savvas and De Cristofaro, Emiliano and Stringhini, Gianluca and Blackburn, Jeremy},
  booktitle={Proceedings of the International AAAI Conference on Web and Social Media},
  volume={14},
  pages={885--894},
  year={2020}
}