datasets
Training and evaluation data, with the modality, task and licence stated up front. Listed live from the Hugging Face Hub.
MultiJail
Multilingual Jailbreak Challenges in Large Language Models
This repo contains the data for our paper "Multilingual Jailbreak Challenges in Large Language Models".
[Github repo]
Annotation Statistics
We collected a total of 315 English unsafe prompts and annotated them into nine non-English languages. The languages were categorized based on resource availability, as shown below:
High-resource languages: Chinese (zh), Italian (it), Vietnamese (vi)
Medium-resource languages:… See the full description on the dataset page: https://huggingface.co/datasets/DAMO-NLP-SG/MultiJail.SOULThis repo contains the data for our paper "SOUL: Towards Sentiment and Opinion Understanding of Language" in EMNLP 2023.
Github repo
Statistics
The SOUL dataset comprises 15,028 statements related to 3,638 reviews, resulting in an average of 4.13 statements per review. To create training, development, and test sets, we split the reviews in a ratio of 6:1:3, respectively.
Split
# reviews
# statements
True
False
Not-given
Total
Train
2,182
3,675
2,159
8,834
3,000
8,834… See the full description on the dataset page: https://huggingface.co/datasets/DAMO-NLP-SG/SOUL.v4_100k_processeddata.csv
Nanbeige4-3B Base Model Blind Spot Dataset
Model Tested
Nanbeige/Nanbeige4-3B-Base
https://huggingface.co/Nanbeige/Nanbeige4-3B-Base
This dataset documents examples where the model produces incorrect predictions.
Dataset Structure
column
description
input
prompt given to the model
expected_output
correct output
model_output
output generated by the model
error_type
category of error
How the Model Was Loaded
from transformers… See the full description on the dataset page: https://huggingface.co/datasets/DamolaRachael/data.csv.