datacommonsorg/datacommons_factcheck

1---2annotations_creators:3- expert-generated4language_creators:5- found6language:7- en8license:9- cc-by-nc-4.010multilinguality:11- monolingual12size_categories:13- 1K<n<10K14- n<1K15source_datasets:16- original17task_categories:18- text-classification19task_ids:20- fact-checking21paperswithcode_id: null22pretty_name: DataCommons Fact Checked claims23dataset_info:24- config_name: fctchk_politifact_wapo25  features:26  - name: reviewer_name27    dtype: string28  - name: claim_text29    dtype: string30  - name: review_date31    dtype: string32  - name: review_url33    dtype: string34  - name: review_rating35    dtype: string36  - name: claim_author_name37    dtype: string38  - name: claim_date39    dtype: string40  splits:41  - name: train42    num_bytes: 177232143    num_examples: 563244  download_size: 67189645  dataset_size: 177232146- config_name: weekly_standard47  features:48  - name: reviewer_name49    dtype: string50  - name: claim_text51    dtype: string52  - name: review_date53    dtype: string54  - name: review_url55    dtype: string56  - name: review_rating57    dtype: string58  - name: claim_author_name59    dtype: string60  - name: claim_date61    dtype: string62  splits:63  - name: train64    num_bytes: 3506165    num_examples: 13266  download_size: 67189667  dataset_size: 3506168config_names:69- fctchk_politifact_wapo70- weekly_standard71---72 73# Dataset Card for DataCommons Fact Checked claims74 75## Table of Contents76- [Dataset Description](#dataset-description)77  - [Dataset Summary](#dataset-summary)78  - [Supported Tasks and Leaderboards](#supported-tasks-and-leaderboards)79  - [Languages](#languages)80- [Dataset Structure](#dataset-structure)81  - [Data Instances](#data-instances)82  - [Data Fields](#data-fields)83  - [Data Splits](#data-splits)84- [Dataset Creation](#dataset-creation)85  - [Curation Rationale](#curation-rationale)86  - [Source Data](#source-data)87  - [Annotations](#annotations)88  - [Personal and Sensitive Information](#personal-and-sensitive-information)89- [Considerations for Using the Data](#considerations-for-using-the-data)90  - [Social Impact of Dataset](#social-impact-of-dataset)91  - [Discussion of Biases](#discussion-of-biases)92  - [Other Known Limitations](#other-known-limitations)93- [Additional Information](#additional-information)94  - [Dataset Curators](#dataset-curators)95  - [Licensing Information](#licensing-information)96  - [Citation Information](#citation-information)97  - [Contributions](#contributions)98 99## Dataset Description100 101- **Homepage:** [Data Commons fact checking FAQ](https://datacommons.org/factcheck/faq)102 103### Dataset Summary104 105A dataset of fact checked claims by news media maintained by [datacommons.org](https://datacommons.org/) containing the claim, author, and judgments, as well as the URL of the full explanation by the original fact-checker.106 107The fact checking is done by [FactCheck.org](https://www.factcheck.org/), [PolitiFact](https://www.politifact.com/), and [The Washington Post](https://www.washingtonpost.com/).108 109### Supported Tasks and Leaderboards110 111[More Information Needed]112 113### Languages114 115The data is in English (`en`).116 117## Dataset Structure118 119### Data Instances120 121An example of fact checking instance looks as follows:122```123{'claim_author_name': 'Facebook posts',124 'claim_date': '2019-01-01',125 'claim_text': 'Quotes Michelle Obama as saying, "White folks are what’s wrong with America."',126 'review_date': '2019-01-03',127 'review_rating': 'Pants on Fire',128 'review_url': 'https://www.politifact.com/facebook-fact-checks/statements/2019/jan/03/facebook-posts/did-michelle-obama-once-say-white-folks-are-whats-/',129 'reviewer_name': 'PolitiFact'}130```131 132### Data Fields133 134A data instance has the following fields:135- `review_date`: the day the fact checking report was posted. Missing values are replaced with empty strings136- `review_url`: URL for the full fact checking report137- `reviewer_name`: the name of the fact checking service.138- `claim_text`: the full text of the claim being reviewed.139- `claim_author_name`: the author of the claim being reviewed. Missing values are replaced with empty strings140- `claim_date` the date of the claim. Missing values are replaced with empty strings141- `review_rating`: the judgments of the fact checker (under `alternateName`, names vary by fact checker)142 143### Data Splits144 145No splits are provided. There are a total of 5632 claims fact-checked.146 147## Dataset Creation148 149### Curation Rationale150 151[More Information Needed]152 153### Source Data154 155#### Initial Data Collection and Normalization156 157[More Information Needed]158 159#### Who are the source language producers?160 161[More Information Needed]162 163### Annotations164 165#### Annotation process166 167[More Information Needed]168 169#### Who are the annotators?170 171The fact checking is done by [FactCheck.org](https://www.factcheck.org/), [PolitiFact](https://www.politifact.com/), [The Washington Post](https://www.washingtonpost.com/), and [The Weekly Standard](https://www.weeklystandard.com/).172 173- [FactCheck.org](https://www.factcheck.org/) self describes as "a nonpartisan, nonprofit 'consumer advocate' for voters that aims to reduce the level of deception and confusion in U.S. politics." It was founded by journalists Kathleen Hall Jamieson and Brooks Jackson and is currently directed by Eugene Kiely.174- [PolitiFact](https://www.politifact.com/) describe their ethics as "seeking to present the true facts, unaffected by agenda or biases, [with] journalists setting their own opinions aside." It was started in August 2007 by Times Washington Bureau Chief Bill Adair. The organization was acquired in February 2018 by the Poynter Institute, a non-profit journalism education and news media research center that also owns the Tampa Bay Times.175- [The Washington Post](https://www.washingtonpost.com/) is a newspaper considered to be near the center of the American political spectrum. In 2013 Amazon.com founder Jeff Bezos bought the newspaper and affiliated publications.176 177The original data source also contains 132 items reviewed by [The Weekly Standard](https://www.weeklystandard.com/), which was a neo-conservative American newspaper. IT is the most politically loaded source of the group, which was originally a vocal creitic of the activity of fact-checking, and has historically taken stances [close to the American right](https://en.wikipedia.org/wiki/The_Weekly_Standard#Support_of_the_invasion_of_Iraq). It also had to admit responsibility for baseless accusations against a well known author in a public [libel case](https://en.wikipedia.org/wiki/The_Weekly_Standard#Libel_case). The fact checked items from this source can be found in the `weekly_standard` configuration but should be used only with full understanding of this context.178 179### Personal and Sensitive Information180 181[More Information Needed]182 183## Considerations for Using the Data184 185### Social Impact of Dataset186 187[More Information Needed]188 189### Discussion of Biases190 191See section above describing the [fact checking organizations](#who-are-the-annotators?).192 193[More Information Needed]194 195### Other Known Limitations196 197Dataset provided for research purposes only. Please check dataset license for additional information.198 199## Additional Information200 201### Dataset Curators202 203This fact checking dataset is maintained by [datacommons.org](https://datacommons.org/), a Google initiative.204 205### Licensing Information206 207All fact checked items are released under a `CC-BY-NC-4.0` License.208 209### Citation Information210 211Data Commons 2020, Fact Checks, electronic dataset, Data Commons, viewed 16 Dec 2020, <https://datacommons.org>.212 213### Contributions214 215Thanks to [@yjernite](https://github.com/yjernite) for adding this dataset.