ALMA
Datasets
All datasets matching “ALMA”Biomed-Enriched
Biomed-Enriched: A Biomedical Dataset Enriched with LLMs for Pretraining and Extracting Rare and Hidden Content
Dataset Authors
Rian Touchent, Nathan Godey & Eric de la ClergerieSorbonne Université, INRIA Paris
Overview
Biomed-Enriched is a PubMed-derived dataset created using a two-stage annotation process. Initially, Llama 3.1 70B Instruct annotated 400K paragraphs for document type, domain, and educational quality. These annotations were then… See the full description on the dataset page: https://huggingface.co/datasets/almanach/Biomed-Enriched.halvest
HALvest
Open Scientific Papers Harvested from HAL (Unfiltered)
Dataset Summary
overview:
This is the unfiltered version of HALvest, comprising of fulltext from open papers found on Hyper Articles en Ligne (HAL) with extra fields for potential filtering. Our dump is mostly english/french but gather papers written in 56 languages across 13 domains.
You can download the dataset using Hugging Face datasets:
from datasets import load_dataset
ds =… See the full description on the dataset page: https://huggingface.co/datasets/almanach/halvest.alma-avatar-quality-pilot-v1X-ALMA-Parallel-Data
This is the translation parallel dataset used by X-ALMA.
@misc{xu2024xalmaplugplay,
title={X-ALMA: Plug & Play Modules and Adaptive Rejection for Quality Translation at Scale},
author={Haoran Xu and Kenton Murray and Philipp Koehn and Hieu Hoang and Akiko Eriguchi and Huda Khayrallah},
year={2024},
eprint={2410.03115},
archivePrefix={arXiv},
primaryClass={cs.CL},
url={https://arxiv.org/abs/2410.03115},
}
ALMA-Human-Parallel
Dataset Card for "ALMA-Human-Parallel"
This is human-written parallel dataset used by ALMA translation models.
@misc{xu2023paradigm,
title={A Paradigm Shift in Machine Translation: Boosting Translation Performance of Large Language Models},
author={Haoran Xu and Young Jin Kim and Amr Sharaf and Hany Hassan Awadalla},
year={2023},
eprint={2309.11674},
archivePrefix={arXiv},
primaryClass={cs.CL}
}
@misc{xu2024contrastive,
title={Contrastive… See the full description on the dataset page: https://huggingface.co/datasets/haoranxu/ALMA-Human-Parallel.halvest-contrastive
HALvest-Contrastive
Contrastive triplets Harvested from HAL
Citation
@misc{kulumba2026doesauthorshipsignalemerge,
title={Where Does Authorship Signal Emerge in Encoder-Based Language Models?},
author={Francis Kulumba and Guillaume Vimont and Laurent Romary and Florian Cafiero},
year={2026},
eprint={2605.19908},
archivePrefix={arXiv},
primaryClass={cs.CL},
url={https://arxiv.org/abs/2605.19908},
}… See the full description on the dataset page: https://huggingface.co/datasets/almanach/halvest-contrastive.