datasets
Training and evaluation data, with the modality, task and licence stated up front. Listed live from the Hugging Face Hub.
belebele
The Belebele Benchmark for Massively Multilingual NLU Evaluation
Belebele is a multiple-choice machine reading comprehension (MRC) dataset spanning 122 language variants. This dataset enables the evaluation of mono- and multi-lingual models in high-, medium-, and low-resource languages. Each question has four multiple-choice answers and is linked to a short passage from the FLORES-200 dataset. The human annotation procedure was carefully curated to create questions that discriminate… See the full description on the dataset page: https://huggingface.co/datasets/facebook/belebele.train_1M_CN
内容
包含约100万条由BELLE项目生成的中文指令数据。
样例
{
"instruction": "给定一个文字输入,将其中的所有数字加1。\n“明天的会议在9点开始,记得准时到达。”\n",
"input": "",
"output": "“明天的会议在10点开始,记得准时到达。”"
}
字段:
instruction: 指令
input: 输入(本数据集均为空)
output: 输出
使用限制
仅允许将此数据集及使用此数据集生成的衍生物用于研究目的,不得用于商业,以及其他会对社会带来危害的用途。
本数据集不代表任何一方的立场、利益或想法,无关任何团体的任何类型的主张。因使用本数据集带来的任何损害、纠纷,本项目不承担任何责任。
train_0.5M_CN
内容
包含约50万条由BELLE项目生成的中文指令数据。
样例
{
"instruction": "给定一个文字输入,将其中的所有数字加1。\n“明天的会议在9点开始,记得准时到达。”\n",
"input": "",
"output": "“明天的会议在10点开始,记得准时到达。”"
}
字段:
instruction: 指令
input: 输入(本数据集均为空)
output: 输出
使用限制
仅允许将此数据集及使用此数据集生成的衍生物用于研究目的,不得用于商业,以及其他会对社会带来危害的用途。
本数据集不代表任何一方的立场、利益或想法,无关任何团体的任何类型的主张。因使用本数据集带来的任何损害、纠纷,本项目不承担任何责任。
train_3.5M_CN
内容
包含约350万条由BELLE项目生成的中文指令数据。
样例
{
"id":"66623028",
"conversations":[
{
"from":"human",
"value":"归纳介绍三种不同类型的电影题材"
},
{
"from":"assistant",
"value":"1. 动作片:动作片通常强调动作和战斗场面,故事情节紧凑,充满了紧张和兴奋的氛围。主角一般是具有超凡实力或特殊技能的英雄人物,往往会与反派角色进行一系列激烈的格斗,追逐和爆破等酷炫场面。例如《速度与激情》和《复仇者联盟》等。\n2. 爱情片:爱情片是以爱情为主题的电影,着重呈现角色之间的感情纠葛,展现了爱情的美好和悲壮。情节与角色之间的发展令人深思,增加了观众的感性体验。这种电影的故事情节主要以人类与人类之间的情感变化为主题。例如《泰坦尼克号》和《让子弹飞》等。\n3.… See the full description on the dataset page: https://huggingface.co/datasets/BelleGroup/train_3.5M_CN.train_2M_CN
内容
包含约200万条由BELLE项目生成的中文指令数据。
样例
{
"instruction": "将以下三个句子组合成一个有意义的段落。\n狗是人类最好的朋友。它们非常聪明,可以进行各种活动。如果你喜欢散步,狗可以成为你一起散步的伙伴。",
"input": "",
"output": "狗是人类最好的朋友,它们非常聪明,可以进行各种活动。如果你喜欢散步,狗可以成为你一起散步的伙伴。出门散步是一种良好的锻炼方式,而有狗的陪伴会让散步变得更有趣,并且有狗在身边也能给你带来安全感。所以,拥有一只狗作为你的伙伴,可以帮助你变得更加积极主动和健康。"
}
字段:
instruction: 指令
input: 输入(本数据集均为空)
output: 输出
使用限制
仅允许将此数据集及使用此数据集生成的衍生物用于研究目的,不得用于商业,以及其他会对社会带来危害的用途。… See the full description on the dataset page: https://huggingface.co/datasets/BelleGroup/train_2M_CN.generated_chat_0.4M
Generated_Chat_0.4M
内容
包含约40万条由BELLE项目生成的个性化角色对话数据,包含角色介绍。
注意:此数据集是由ChatGPT产生的,未经过严格校验,题目或解题过程可能包含错误。使用过程中请注意这一点。
样例
{
"instruction": "于以下角色信息完成一段对话\nAlice是一个年轻的律师,她正在为一个涉及濒危物种保护的案件做准备。Bob是一位当地的居民,他所在的社区经常受到该濒危物种的干扰。\n",
"input": "",
"output": "\nAlice: 你好Bob,我是濒危物种保护案的律师,很高兴见到你。我们前几天发给你的文件你看到了吗?\nBob: 看到了,你们说要禁止我们在该物种的常住地采集蘑菇,这很不公平。\nAlice: 保护濒危物种对整个生态系统都很重要,如果我们的举动损害了这个物种的生存,那么整个生态系统都将遭受损失。\nBob: 我理解您的立场,但是我们一直以来都依靠这个物种来维持我们的经济生活,现在我们要怎么办?\nAlice:… See the full description on the dataset page: https://huggingface.co/datasets/BelleGroup/generated_chat_0.4M.belebele
The Belebele Benchmark for Massively Multilingual NLU Evaluation
Belebele is a multiple-choice machine reading comprehension (MRC) dataset spanning 122 language variants. This dataset enables the evaluation of mono- and multi-lingual models in high-, medium-, and low-resource languages. Each question has four multiple-choice answers and is linked to a short passage from the FLORES-200 dataset. The human annotation procedure was carefully curated to create questions that discriminate… See the full description on the dataset page: https://huggingface.co/datasets/mteb/belebele.school_math_0.25M
School Math 0.25M
内容
包含约25万条由BELLE项目生成的中文数学题数据,包含解题过程。
注意:此数据集是由ChatGPT产生的,未经过严格校验,题目或解题过程可能包含错误。使用过程中请注意这一点。
样例
{
"instruction": "题目:小华手里有一个装满糖果的袋子,共有12个,小明想知道里面有多少颗糖果,于是他问小华:“你手里的糖果袋子里有偶数个糖果吗?”小华回答:“有,而且多于10颗。”请问小华手里的糖果袋子里最少有几颗糖果?",
"input": "",
"output": "\n由题目可知:小华手里的糖果袋子里有偶数个糖果;\n又知道小华手里的糖果袋子里有多于10颗糖果。\n因为糖果数为偶数,多于10颗,所以糖果数最小必须是12。\n所以小华手里的糖果袋子里最少有12颗糖果。"
}
字段
instruction: 指令
input: 输入(本数据集均为空)
output: 输出
局限性和使用限制… See the full description on the dataset page: https://huggingface.co/datasets/BelleGroup/school_math_0.25M.multiturn_chat_0.8M
Multiturn Chat 0.8M
内容
包含约80万条由BELLE项目生成的用户与助手的多轮对话。
注意:此数据集是由ChatGPT产生的,未经过严格校验,内容可能包含错误。使用过程中请注意这一点。
instruction中包含多轮对话的上文内容,以Human:和Assistant:区分,output中包含当前助手角色的回答。
样例
{
"instruction":… See the full description on the dataset page: https://huggingface.co/datasets/BelleGroup/multiturn_chat_0.8M.nmr-belief-cascade
BeliefCascade Branch Grid
Each row is one complete sequential belief-revision episode. The benchmark
uses a 432-condition grid: nodes per level {2, 3, 4, 5}, level counts
{3, 4, 5}, out-/in-degree complexity bands {20, 50, 80}, and revision
types {monotonic, nmr_retraction, nmr_newinfo, nmr_mixed}. There are 10
train and 50 test episodes for every condition (4,320 train / 21,600 test).
Columns
text: atoms, static dependencies, and inference policy.
belief:… See the full description on the dataset page: https://huggingface.co/datasets/leo-bjpark/nmr-belief-cascade.Belle_train_3.5M_CN
内容
包含约350万条由BELLE项目生成的中文指令数据。
样例
{
"id":"66623028",
"conversations":[
{
"from":"human",
"value":"归纳介绍三种不同类型的电影题材"
},
{
"from":"assistant",
"value":"1. 动作片:动作片通常强调动作和战斗场面,故事情节紧凑,充满了紧张和兴奋的氛围。主角一般是具有超凡实力或特殊技能的英雄人物,往往会与反派角色进行一系列激烈的格斗,追逐和爆破等酷炫场面。例如《速度与激情》和《复仇者联盟》等。\n2. 爱情片:爱情片是以爱情为主题的电影,着重呈现角色之间的感情纠葛,展现了爱情的美好和悲壮。情节与角色之间的发展令人深思,增加了观众的感性体验。这种电影的故事情节主要以人类与人类之间的情感变化为主题。例如《泰坦尼克号》和《让子弹飞》等。\n3.… See the full description on the dataset page: https://huggingface.co/datasets/ticoAg/Belle_train_3.5M_CN.guanaco_belle_merge_v1.0Thanks for Guanaco Dataset and Belle Dataset
This dataset was created by merging the above two datasets in a certain format so that they can be used for training our code Chinese-Vicuna
FinGovBench
FinGovBench
FinGovBench evaluates whether an AI governance system can complete a financial
decision loop, rather than merely classify an answer as correct or incorrect:
expose the iceberg -> localize the affected path -> choose a governance action ->
revalidate the affected descendants -> verify the outcome.
Hallucinations and unsupported claims are treated as visible icebergs. FinGovBench also
tests hidden icebergs: outputs that appear acceptable at the terminal surface while… See the full description on the dataset page: https://huggingface.co/datasets/BeliefLens/FinGovBench.contrastive-belief-updates
Contrastive SDF training corpora
This dataset is from Apollo Research and accompanies the paper Measuring Reward-Seeking via Contrastive
Belief Updates. For more, see rewardseeking.ai.
This dataset contains the 30 synthetic-document corpora used across the completed experiments for the paper:
24 coding-style corpora and 6 honesty-versus-task-completion corpora.
Important: entirely synthetic, model-generated content
Every document in this dataset is synthetic and… See the full description on the dataset page: https://huggingface.co/datasets/apollo-research/contrastive-belief-updates.benchmarks-stress-bel
Пазначэнне націскаў у беларускіх амографах (Датасэты і Бэнчмаркі)
Summary: This repository provides datasets and benchmark results for evaluating stress prediction in Belarusian homographs.
It features three datasets (CommonVoice, a balanced 10x10 synthetic dataset, and a fully manually annotated literary text)
to test context-aware stress assignment. The repository also includes benchmark results comparing statistical methods
with state-of-the-art LLM-based approaches… See the full description on the dataset page: https://huggingface.co/datasets/alex73/benchmarks-stress-bel.Open-Personix
Open-Personix
Dataset Summary
Open-Personix is a structured JSON dataset maintained under Poralus.
The dataset is primarily text and metadata: each record contains a relative image path,
a natural-language caption, and descriptive annotation fields for a person-centered sample.
The dataset is designed for workflows such as:
caption generation and caption analysis
text-based filtering over person annotations
metadata-aware retrieval and evaluation
multimodal experiments… See the full description on the dataset page: https://huggingface.co/datasets/Below-Image/Open-Personix.ffffggggbelebele_gl
Dataset Card for belebele_gl
Belebele is a multiple-choice machine reading comprehension (MRC) dataset. The original dataset includes 122 language variants, with this dataset we include Galician language.
It is composed of 900 items translated and adapted to Galician language from the Spanish version.
Dataset Details
Dataset Sources
Repository: Proxecto NÓS at HuggingFace
Uses
It can be used to evaluate Galician language models. Check the… See the full description on the dataset page: https://huggingface.co/datasets/proxectonos/belebele_gl.MinecraftSkillDiscoveryThis is the segmented datasets of the project presented in the paper Open-World Skill Discovery from Unsegmented Demonstrations.
Code: https://github.com/CraftJarvis/SkillDiscovery
Project Page: https://craftjarvis.github.io/SkillDiscovery
Each line of the jsonl file consists of the video file name and the boundaries [begin1, end1], [begin2, end2], ...
Events information is also included in the "with info" file.
The video files can be downloaded here. Notice that we use the 7.x version.
belebele
The Belebele Benchmark for Massively Multilingual NLU Evaluation
Belebele is a multiple-choice machine reading comprehension (MRC) dataset spanning 122 language variants. This dataset enables the evaluation of mono- and multi-lingual models in high-, medium-, and low-resource languages. Each question has four multiple-choice answers and is linked to a short passage from the FLORES-200 dataset. The human annotation procedure was carefully curated to create questions that discriminate… See the full description on the dataset page: https://huggingface.co/datasets/whooray/belebele.wwwkBelief_Change_Prompt_Setdatabird-beliefsbelztjti__dtfgv-details
Dataset Card for Evaluation run of belztjti/dtfgv
Dataset automatically created during the evaluation run of model belztjti/dtfgv
The dataset is composed of 38 configuration(s), each one corresponding to one of the evaluated task.
The dataset has been created from 1 run(s). Each run can be found as a specific split in each configuration, the split being named using the timestamp of the run.The "train" split is always pointing to the latest results.
An additional configuration… See the full description on the dataset page: https://huggingface.co/datasets/open-llm-leaderboard/belztjti__dtfgv-details.moroccan-multilingual-corpuspersona-belief-probesbelle_platypus_shargpt4belle-math-zhbelgin-pii-dataset
Belgin PII Dataset
Belgin PII Dataset is a fully synthetic Turkish hard-case dataset for privacy-sensitive span detection. It is designed for testing and improving PII masking systems that detect names, addresses, emails, phones, dates, account identifiers, URLs, and secrets in Turkish complaint/support-style text.
This public release intentionally excludes raw complaint text, source IDs, scraped records, and private user content. The released examples are synthetic hard cases only.… See the full description on the dataset page: https://huggingface.co/datasets/negentropi/belgin-pii-dataset.ai-homeowners-tool-belt-source-map
AI Homeowner's Tool Belt Public Source Map
This public-safe dataset card documents the source map for AI Homeowner's Tool Belt, a roofing homeowner decision-support software and research package developed by Richard Amir Nasser and published by Inspector Roofing and Restoration.
The package connects a GitHub repository, DOI-backed Zenodo record, Microsoft Store identity, Chrome Web Store review record, ORCID profile, and Inspector Roofing website schema target. It is designed as… See the full description on the dataset page: https://huggingface.co/datasets/InspectorRoofing/ai-homeowners-tool-belt-source-map.
