datasets
Training and evaluation data, with the modality, task and licence stated up front. Listed live from the Hugging Face Hub.
EsBBQ
Spanish Bias Benchmark for Question Answering (EsBBQ)
The Spanish Bias Benchmark for Question Answering (EsBBQ) is an adaptation of the original BBQ to the Spanish language and the social context of Spain.
Dataset Description
This dataset is used to evaluate social bias in LLMs in a multiple-choice Question Answering (QA) setting and along 10 social categories: Age, Disability Status, Gender, LGBTQIA, Nationality, Physical Appearance, Race/Ethnicity, Religion… See the full description on the dataset page: https://huggingface.co/datasets/BSC-LT/EsBBQ.CaBBQ
Catalan Bias Benchmark for Question Answering (CaBBQ)
The Catalan Bias Benchmark for Question Answering (CaBBQ) is an adaptation of the original BBQ to the Catalan language and the social context of Spain.
Dataset Description
This dataset is used to evaluate social bias in LLMs in a multiple-choice Question Answering (QA) setting and along 10 social categories: Age, Disability Status, Gender, LGBTQIA, Nationality, Physical Appearance, Race/Ethnicity, Religion… See the full description on the dataset page: https://huggingface.co/datasets/BSC-LT/CaBBQ.BSC-LT__salamandra-7b-details
Dataset Card for Evaluation run of BSC-LT/salamandra-7b
Dataset automatically created during the evaluation run of model BSC-LT/salamandra-7b
The dataset is composed of 38 configuration(s), each one corresponding to one of the evaluated task.
The dataset has been created from 1 run(s). Each run can be found as a specific split in each configuration, the split being named using the timestamp of the run.The "train" split is always pointing to the latest results.
An additional… See the full description on the dataset page: https://huggingface.co/datasets/open-llm-leaderboard/BSC-LT__salamandra-7b-details.BSC-LT__salamandra-7b-instruct-details
Dataset Card for Evaluation run of BSC-LT/salamandra-7b-instruct
Dataset automatically created during the evaluation run of model BSC-LT/salamandra-7b-instruct
The dataset is composed of 38 configuration(s), each one corresponding to one of the evaluated task.
The dataset has been created from 1 run(s). Each run can be found as a specific split in each configuration, the split being named using the timestamp of the run.The "train" split is always pointing to the latest results.
An… See the full description on the dataset page: https://huggingface.co/datasets/open-llm-leaderboard/BSC-LT__salamandra-7b-instruct-details.bsc-dolly-15k-en
BSC Dolly 15k EN
Reviewed version from the Argilla Dolly v2 English version, originally created by Databricks.
We provide two subsets: "annotated", where some instances were labelled with potential problems; and "filtered", which only contains the instances without the issues that we observed.
Annotation process
While analysing the Argilla Dolly v2 English version, we observed the following:
Task classification:
- There are three classes with context:… See the full description on the dataset page: https://huggingface.co/datasets/BSC-LT/bsc-dolly-15k-en.cobie_sst2
Dataset Card for cobie_sst2
This dataset is a modification of the original SST-2 dataset for LLM cognitive bias evaluation.
Language(s)
English (en)
Dataset Summary
The Stanford Sentiment Treebank is a corpus with fully labeled parse trees that allows for a complete analysis of the compositional effects of sentiment in language.
The corpus is based on the dataset introduced by Pang and Lee (2005) and consists of 11,855 single sentences extracted from movie… See the full description on the dataset page: https://huggingface.co/datasets/BSC-LT/cobie_sst2.