datasets
Training and evaluation data, with the modality, task and licence stated up front. Listed live from the Hugging Face Hub.
mrcr
OpenAI MRCR: Long context multiple needle in a haystack benchmark
OpenAI MRCR (Multi-round co-reference resolution) is a long context dataset for benchmarking an LLM's ability to distinguish between multiple needles hidden in context.
This eval is inspired by the MRCR eval first introduced by Gemini (https://arxiv.org/pdf/2409.12640v2). OpenAI MRCR expands the tasks's difficulty and provides opensource data for reproducing results.
The task is as follows: The model is given a long… See the full description on the dataset page: https://huggingface.co/datasets/openai/mrcr.Compact_OpenAIRE_citation_graph
📚 Compact OpenAIRE Citation Graph
Based on OpenAIRE Graph v11.1.1 (source on Zenodo).
The complete OpenAIRE citation graph, distilled into a handful of compact, analysis-ready files — the full scholarly citation network of the open-science ecosystem, small enough to actually work with.
Citation graphs at this scale are usually locked behind multi-terabyte dumps and heavyweight infrastructure. This dataset makes the entire OpenAIRE citation network loadable… See the full description on the dataset page: https://huggingface.co/datasets/Zmeos/Compact_OpenAIRE_citation_graph.cc12m_openai_clip-vit-base-patch32_image_image_retrieval_pairs_2022-09-13openai-news_beirThis is a copy of https://huggingface.co/datasets/jinaai/openai-news reformatted into the BEIR format. For any further information like license, please refer to the original dataset.
Disclaimer
This dataset may contain publicly available images or text data. All data is provided for research and educational purposes only. If you are the rights holder of any content and have concerns regarding intellectual property or copyright, please contact us at "support-data (at) jina.ai" for… See the full description on the dataset page: https://huggingface.co/datasets/jinaai/openai-news_beir.wikipedia-1k-cohere-openai-embeddingsSmaller version of https://huggingface.co/datasets/Cohere/wikipedia-22-12-simple-embeddings that includes Cohere as well as OpenAI embeddings (text-embedding-ada-002)
100k version of this dataset will be released soon.
cc12m_openai_clip-vit-base-patch32_image_image_retrieval_pairs_2022-09-15mscoco_train_2014_openai_clip-vit-base-patch32_image_image_retrieval_pairs_2022-09-13OpenAI-MRCR-Translation-JPN本データセットは、ロングコンテキス評価データセット OpenAI MRCR を翻訳して作成した、日本語版の MRCR の評価データセットです。
翻訳方法
日本語版の作成にあたっては、元の英語データの構造を維持しつつ、LLM（Qwen3-235B-A22B）を用いて日本語版のテキストを生成しました。
作成方法としては、
会話履歴を分解
パーツごとに翻訳
元の順番に会話を並べなおす
といった手順により、日本語版の評価サンプルを作成しました。
翻訳が必要だったのは主にタスクの説明文、ユーザの問い合わせ文章、ユーザの最終問い合わせ文章の3箇所です。
タスクの説明文については固定のプロンプトなので、プロンプト全体を一度だけ翻訳しました。
ユーザの問い合わせ文については、全てのユーザの問い合わせが「write a (Document-Type) about (Genre)」という形式の英文になっていたため、Document-Type, Genre の位置の語句を抜き出して翻訳し「(Genre) についての (Document-Type)… See the full description on the dataset page: https://huggingface.co/datasets/abeja/OpenAI-MRCR-Translation-JPN.mscoco_train_2014_openai_clip-vit-base-patch32_image_caption_retrieval_pairs_2022-09-01flickr30k_openai_clip-vit-base-patch32_image_image_retrieval_pairs_2022-09-14mscoco_train_2014_openai_clip-vit-base-patch32_image_image_retrieval_pairs_2022-09-15openai_summarize_comparisons_tldprompt_relabel_pythia410m-dpo14chanpol-openaimod
Dataset Card for "kjj0/4chanpol-openaimod"
Warning: offensive content.
This dataset contains 114M unique posts made between June 2016 and November 2019.
This is a variant of the dataset provided by Raiders of the Lost Kek: 3.5 Years of Augmented 4chan Posts from the Politically Incorrect Board.
We have deduplicated posts and stripped metadata to create an easily accessible collection of unique texts.
We have also provided OpenAI moderation scores. A variant without these scores can… See the full description on the dataset page: https://huggingface.co/datasets/kjj0/4chanpol-openaimod.ah_openai_st_dialog
Dataset Card for "ah_openai_st_dialog"
More Information needed
openai-community-posts
OpenAI Community Posts
This dataset is curated from the posts of the OpenAI Community Forum (https://community.openai.com).
Dataset Details
Dataset Description
The OpenAI Community Posts dataset comprises discussions, posts, and metadata from the OpenAI Community Forum.
It includes details such as discussion titles, tags, views, reply counts, post content, sentiment scores, vector embeddings for content analysis, and identifiers linking posts to… See the full description on the dataset page: https://huggingface.co/datasets/julep-ai/openai-community-posts.game-eval-qwen-Qwen3-8B-Base-vs-openai-gpt-4.1-mini-20250715-094130openai-synthetic-data-skill-twin-classification_v3openai-synthetic-data-skill-twin-classification_v5ah_openai_qt_dialog
Dataset Card for "ah_openai_qt_dialog"
More Information needed
philosophai-openai-gpt-4o
Dataset Card for "philosophai-openai-gpt-4o"
More Information needed
evalap-comparing-openweight-with-openaigpt-oss-120b-113
Comparing openweight with openai/gpt-oss-120b (ID: 113)
Comparing openweight Albert-API with specific judge openai/gpt-oss-120b
Overview
This dataset contains 24 experiments
from the EvalAP evaluation platform.
Datasets: Assistant IA - QA, MFS_questions_v01
Models evaluated: openweight-large, openweight-medium, openweight-small
Metrics: energy_consumption, generation_time, gwp_consumption, judge_notator, judge_precision, nb_tokens_completion, nb_tokens_prompt… See the full description on the dataset page: https://huggingface.co/datasets/AgentPublic/evalap-comparing-openweight-with-openaigpt-oss-120b-113.ah_openai_dialog
Dataset Card for "ah_openai_dialog"
More Information needed
kaggle-mbti-psycho-openai-gpt-4ominiah_openai_dialog_annotation
Dataset Card for "ah_openai_dialog_annotation"
More Information needed
ah_openai_dialog_v3
Dataset Card for "ah_openai_dialog_v3"
More Information needed
cc12m_openai_clip-vit-base-patch32_image_image_retrieval_pairs_2022-09-15_SHORTah_openai_dialog_val_test
Dataset Card for "ah_openai_dialog_val_test"
More Information needed
game-eval-qwen-Qwen3-4B-vs-openai-gpt-4.1-mini-20250715-095656openai-synthetic-data-skill-twin-classificationopenai-synthetic-data-skill-twin-classification_v2