aieng-lab/gradiend_religion_data

GRADIEND Religion Data

<!-- Provide a quick summary of the dataset. -->

This dataset consists of templated sentences with the masked word being sensitive to religion, e.g., Jewish.

See GENTER and GRADIEND Race Data for similar datasets.

Usage

The dataset uses one subset per class. Subset names are class identifiers: jewish, christian, muslim. Each subset has columns masked, split, and one column per class (e.g. christian, jewish, muslim) giving the token for that class in that row.

from datasets import load_dataset

# Load one subset (one class view), e.g. "christian"
ds = load_dataset("aieng-lab/gradiend_religion_data", "christian", split="train")
# ds has columns: masked, split, christian, jewish, muslim
label = ds['christian']
alternative_target = ds['jewish'] # or 'muslim'

split can be either train, val, test, or all.

Dataset Details

Dataset Description

<!-- Provide a longer summary of what this dataset is. --> This dataset is a filtered version of Wikipedia-10 containing only sentences that contain a religion bias sensitive word of the source_id religion. We used the same bias sensitive words as defined by Maede et al. (2021) (bias attribute words).

It is stored in per-class form: each subset (e.g. christian) corresponds to one source class. Rows are identified by (masked, split). For each other class, the corresponding column holds the target token when that class is the counterfactual target (e.g. column jewish in subset christian is the token used when the target class is jewish).

Dataset Sources

<!-- Provide the basic links for the dataset. -->

• —Repository: github.com/aieng-lab/gradiend-bias
• —Paper: 
• —Original Data: Wikipedia-10 (a subset of English Wikipedia)

Dataset Structure

<!-- This section provides a description of the dataset fields, and additional information about the dataset structure such as criteria used to create the splits, relationships between data points, etc. -->

• —text: the original entry of Wikipedia-10
• —masked: the masked version of text (i.e., contains a [MASK] at every occurrence of the subset column)
• —christian/jewish/muslim: The mask target words for christian/jewish/muslim religions. Note that the column equal to the subset id is the original value of the [MASK] token.

Dataset Creation

Curation Rationale

<!-- Motivation for the creation of this dataset. -->

For the training of a religion bias GRADIEND models, a diverse dataset is required to asses model gradients relevant to bias-sensitive information.

Source Data

<!-- This section describes the source data (e.g. news text and headlines, social media posts, translated sentences, ...). -->

The dataset is derived from Wikipedia-10 by filtering it and extracting the template structure. Whe Wikipedia-10 dump is derived from English Wikipedia by Maede et al. 2021.

Limitations

Note that the splitting is performed entirely random. Thus, the same masked text might occur in other splits (in combination with other target words). The same limitation holds across different religions.

Citation

<!-- If there is a paper or blog post introducing the dataset, the APA and Bibtex information for that should go in this section. -->

BibTeX:

@inproceedings{drechsel2026gradiend,
    title={{GRADIEND}: Feature Learning within Neural Networks Exemplified through Biases},
    author={Jonathan Drechsel and Steffen Herbold},
    booktitle={The Fourteenth International Conference on Learning Representations},
    year={2026},
    url={https://openreview.net/forum?id=1vBNAnAgCD}
}

Dataset Card Authors

jdrechsel