datasets
Training and evaluation data, with the modality, task and licence stated up front. Listed live from the Hugging Face Hub.
ApolloCorpus
Multilingual Medicine: Model, Dataset, Benchmark, Code
Covering English, Chinese, French, Hindi, Spanish, Hindi, Arabic So far
👨🏻💻Github •📃 Paper • 🌐 Demo • 🤗 ApolloCorpus • 🤗 XMedBench
中文 | English
🌈 Update
[2024.03.07] Paper released.
[2024.02.12] ApolloCorpus and XMedBench is published！🎉
[2024.01.23] Apollo repo is published！🎉
Results
Apollo-0.5B • 🤗 Apollo-1.8B • 🤗 Apollo-2B • 🤗 Apollo-6B • 🤗 Apollo-7B… See the full description on the dataset page: https://huggingface.co/datasets/FreedomIntelligence/ApolloCorpus.LongTimeScopeIf you use TimeScope please cite the following:
@misc{zohar2025apollo2,
title = {Apollo2: Exploring the Long-Video Frontier of Large Multimodal Models},
author = {Zohar, Orr and Wang, Xiaohan and Li, Rui and Marafioti, Andrés and Farré, Miquel and Noyan, Merve and von Werra, Leandro and Yeung-Levy, Serena and Wolf, Thomas},
year = {2025},
}
sae-skeskinen-TinyStories-hf-validation-tokenizer-gpt2_playTimeScopeIf you use TimeScope please cite the following:
@misc{zohar2025apollo2,
title = {Apollo2: Exploring the Long-Video Frontier of Large Multimodal Models},
author = {Zohar, Orr and Wang, Xiaohan and Li, Rui and Marafioti, Andrés and Farré, Miquel and Noyan, Merve and von Werra, Leandro and Yeung-Levy, Serena and Wolf, Thomas},
year = {2025},
}
prolongvidvideomindApolloMoEDataset
Democratizing Medical LLMs For Much More Languages
Covering 12 Major Languages including English, Chinese, French, Hindi, Spanish, Arabic, Russian, Japanese, Korean, German, Italian, Portuguese and 38 Minor Languages So far.
📃 Paper • 🌐 Demo • 🤗 ApolloMoEDataset • 🤗 ApolloMoEBench • 🤗 Models •🌐 Apollo • 🌐 ApolloMoE
🌈 Update
[2024.10.15] ApolloMoE repo is published！🎉
Languages Coverage
12 Major Languages and 38 Minor Languages
Click to… See the full description on the dataset page: https://huggingface.co/datasets/FreedomIntelligence/ApolloMoEDataset.Apollo-VL-Massive-Dataset
🧬 Apollo-VL-Massive-Dataset
Apollo-VL-Massive-Dataset is a 161,562-row multimodal dataset engineered to train Vision-Language Models (VLMs) to perform structured visual reasoning using <think> tags before producing a final answer.
Designed by Pluto AI Labs, the dataset is optimized for knowledge distillation, behavioral cloning, visual reasoning, OCR, chart understanding, and multimodal instruction tuning of compact VLMs.
📊 Dataset Overview
Property… See the full description on the dataset page: https://huggingface.co/datasets/Pluto-AI-Labs/Apollo-VL-Massive-Dataset.ApolloMoEBench
Democratizing Medical LLMs For Much More Languages
Covering 12 Major Languages including English, Chinese, French, Hindi, Spanish, Arabic, Russian, Japanese, Korean, German, Italian, Portuguese and 38 Minor Languages So far.
📃 Paper • 🌐 Demo • 🤗 ApolloMoEDataset • 🤗 ApolloMoEBench • 🤗 Models •🌐 Apollo • 🌐 ApolloMoE
🌈 Update
[2024.10.15] ApolloMoE repo is published！🎉
Languages Coverage
12 Major Languages and 38 Minor Languages
Click to… See the full description on the dataset page: https://huggingface.co/datasets/FreedomIntelligence/ApolloMoEBench.ApolloCorpus-ja-askllm-v1
ApolloCorpus-ja-askllm-v1
データセット kunishou/ApolloCorpus-ja に対して、 Ask-LLM 手法でスコア付けしたデータセットです。
元データセットのカラムに加え askllm_score というカラムが追加されており、ここに Ask-LLM のスコアが格納されています。
Ask-LLM でスコア付けに使用した LLM は Rakuten/RakutenAI-7B-instruct で、プロンプトは以下の通りです。
###
{data}
###
Does the previous paragraph demarcated within ### and ### contain informative signal for pre-training a large-language model? An informative datapoint should be well-formatted, contain some usable knowledge of the world, and strictly… See the full description on the dataset page: https://huggingface.co/datasets/geniacllm/ApolloCorpus-ja-askllm-v1.fullstackbench-tasks
fullstackbench-tasks
Harbor task definitions used to benchmark coding agents in the FullStackBench / Loki research program. Each top-level directory is one self-contained task — Dockerfile, golden app, verifier, instruction — runnable via harbor run.
Prerequisites
hf CLI logged in to an ApolloTeam-member account (hf auth login)
Working install of Harbor — provides the harbor CLI (ask the Loki team if you don't already have it set up)
Docker daemon running locally
~4 GB… See the full description on the dataset page: https://huggingface.co/datasets/ApolloTeam/fullstackbench-tasks.fullstackbench-trajectories
fullstackbench-trajectories
FullStackBench tasks and the agent trajectories that ran them. One repo, two sibling trees keyed by the same task ID.
Layout
tasks/
└── <task-id>/ # task definition
├── environment/ # docker-compose, source app, fixtures
├── tests/ # verifier scripts
└── solution/ # reference impl (if applicable)
trajectories/
└── <task-id>/… See the full description on the dataset page: https://huggingface.co/datasets/ApolloTeam/fullstackbench-trajectories.contrastive-belief-updates
Contrastive SDF training corpora
This dataset is from Apollo Research and accompanies the paper Measuring Reward-Seeking via Contrastive
Belief Updates. For more, see rewardseeking.ai.
This dataset contains the 30 synthetic-document corpora used across the completed experiments for the paper:
24 coding-style corpora and 6 honesty-versus-task-completion corpora.
Important: entirely synthetic, model-generated content
Every document in this dataset is synthetic and… See the full description on the dataset page: https://huggingface.co/datasets/apollo-research/contrastive-belief-updates.apollo-11-air-to-ground-transcript
Apollo 11 Air-to-Ground Transcript
Cleaned dialogue from the Apollo 11 Technical Air-to-Ground Voice Transmission (GOSS NET 1).
Each line is one utterance in the form speaker: message. Ground-station markers are kept as STATION: MILA (REV 1).
Source
NASA ALSJ: Apollo 11 Technical Air-to-Ground Voice Transcription
This is a cleaned derivative of that public-domain transcript.
STATION: MILA (REV 1) CDR: Roger. Clock. CC: Apollo 11, Houston. You're good at 1… See the full description on the dataset page: https://huggingface.co/datasets/MEBestawy/apollo-11-air-to-ground-transcript.ReOpus-ApolloBooks-EN-NL-1M
ReOpus-ApolloBooks-1M
A high-quality English-Dutch (EN-NL) parallel corpus containing 1 million sentence pairs, constructed through strategic sampling and neural retranslation.
Overview
ReOpus-ApolloBooks-1M is a parallel translation corpus designed for training and evaluating English-Dutch machine translation systems. The corpus combines carefully sampled data from OPUS with neural retranslation using Qwen models, augmented with the Apollo Books parallel corpus.… See the full description on the dataset page: https://huggingface.co/datasets/OpenOranje/ReOpus-ApolloBooks-EN-NL-1M.rootxhacker__Apollo-70B-details
Dataset Card for Evaluation run of rootxhacker/Apollo-70B
Dataset automatically created during the evaluation run of model rootxhacker/Apollo-70B
The dataset is composed of 38 configuration(s), each one corresponding to one of the evaluated task.
The dataset has been created from 1 run(s). Each run can be found as a specific split in each configuration, the split being named using the timestamp of the run.The "train" split is always pointing to the latest results.
An additional… See the full description on the dataset page: https://huggingface.co/datasets/open-llm-leaderboard/rootxhacker__Apollo-70B-details.TimeScope-v0apollo-11-diarized
Apollo 11 Mission Audio — Diarized Transcripts
Machine-generated transcripts with speaker diarization and timestamps for
103 tapes (175 hours) of Apollo 11 mission audio from the
Internet Archive's Apollo11Audio
collection (NASA recordings, public domain).
Generated in a single Hugging Face Job with
OpenMOSS-Team/MOSS-Transcribe-Diarize
(0.9B, Apache 2.0) — joint transcription + speaker attribution + timestamps in one
generation pass per clip.
Configs
segments… See the full description on the dataset page: https://huggingface.co/datasets/davanstrien/apollo-11-diarized.ApolloApolloCorpus-ja
ApolloCorpus-ja
概要
多言語医療データセットの ApolloCorpus を日本語に自動翻訳した 525k の指示チューニングデータセットになります。ApolloCorpus は、オープンソースでかつ品質を担保できるデータのみをスクリーニングし収集されたデータセットになります。詳細は 論文 をご覧下さい。
翻訳対象ファイル
データ量が多いのでひとまず以下の 1 ファイルのみを翻訳しました。なお、英語以外のデータセットについては翻訳品質が低くくなるため、英語データセットのみを日本語に自動翻訳しました（今後、他のファイルを追加で翻訳する場合も英語データのファイルのみを対象にすると思います）。
medicalPaper_en_qa.json (525k)
使用上の注意
多言語データセットを自動翻訳で日本語に翻訳したものであり、翻訳誤りも一部含まれています。医療領域での LLM に利用する際は十分注意した上で使用して下さい。
apollo_english_guidelines_translated_to_dutch_with_gpt4omini
Data description
Translation of the English medical guidelines that are part of the Apollo corpus, using the LLM GPT 4o mini
Acknowledgement
The work received funding from the European Union's Horizon Europe research
and innovation programme under Grant Agreement No. 101057849 (DataTools4Heart project).
For more information on the background, see Datatools4Heart Huggingface/Website/Git
BCE-Prettybird-Nano-Apollo-v0.1
BCE-Prettybird-Nano-Apollo-v0.1 Synthetic Multi-Language Software Engineering & UI/UX Dataset (1,070 Examples)
This dataset contains 1,070 synthetic, high-quality examples covering a broad range of software engineering, architecture, database development, web design, UI/UX design, and design pattern implementations across multiple programming languages and frameworks.
The collection includes:
SOLID principle code examples in PHP, C#, Python, C++, Java, and JavaScript
Design… See the full description on the dataset page: https://huggingface.co/datasets/pthinc/BCE-Prettybird-Nano-Apollo-v0.1.apollo-llama3.3apollo_english_guidelines_translated_to_dutch_with_nllb200
Data description
Translation of the English medical guidelines that are part of the Apollo corpus, using the NLLB200-600M NTM.
Acknowledgement
The work received funding from the European Union's Horizon Europe research
and innovation programme under Grant Agreement No. 101057849 (DataTools4Heart project).
For more information on the background, see Datatools4Heart Huggingface/Website/Git
videochat_flashapollo-preview-v0.4
apollo-preview-v0.4
Apollo is a RP/ERP dataset, which has been generated by amalgamating several data sources with roleplay, creative writing, and general instruction following data. This version is a preview version, with future versions planned to include our own data generation pipelines.
The data sources were generated using Claude 3 Opus, Claude 3.5 Sonnet, GPT-4o, GPT-4, and other open-sourced language models.
Data sources
This dataset was generated from the… See the full description on the dataset page: https://huggingface.co/datasets/QuasarResearch/apollo-preview-v0.4.apollo_english_books_translated_to_dutch_with_geminiflash15
Data description
Translation of the English medical books that are part of the Apollo corpus, using the LLM Gemini Flash 1.5
Acknowledgement
The work received funding from the European Union's Horizon Europe research
and innovation programme under Grant Agreement No. 101057849 (DataTools4Heart project).
For more information on the background, see Datatools4Heart Huggingface/Website/Git
apollo_english_guidelines_translated_to_dutch_with_geminiflash1.5
Data description
Translation of the English medical guidelines that are part of the Apollo corpus, using the LLM Gemini Flash 1.5
Acknowledgement
The work received funding from the European Union's Horizon Europe research
and innovation programme under Grant Agreement No. 101057849 (DataTools4Heart project).
For more information on the background, see Datatools4Heart Huggingface/Website/Git
rootxhacker__Apollo_v2-32B-details
Dataset Card for Evaluation run of rootxhacker/Apollo_v2-32B
Dataset automatically created during the evaluation run of model rootxhacker/Apollo_v2-32B
The dataset is composed of 38 configuration(s), each one corresponding to one of the evaluated task.
The dataset has been created from 1 run(s). Each run can be found as a specific split in each configuration, the split being named using the timestamp of the run.The "train" split is always pointing to the latest results.
An… See the full description on the dataset page: https://huggingface.co/datasets/open-llm-leaderboard/rootxhacker__Apollo_v2-32B-details.ApolloAuto-zyx-apollo
Dataset Card for "ApolloAuto-zyx-apollo"
More Information needed