bertin
Datasets
All datasets matching “bertin”mc4-es-sampled50 million documents in Spanish extracted from mC4 applying perplexity sampling via mc4-sampling: "https://huggingface.co/datasets/bertin-project/mc4-sampling". Please, refer to BERTIN Project. The original dataset is the Multlingual Colossal, Cleaned version of Common Crawl's web crawl corpus (mC4), based on the Common Crawl dataset: "https://commoncrawl.org", and processed by AllenAI.alpaca-spanish
BERTIN Alpaca Spanish
This dataset is a translation to Spanish of alpaca_data_cleaned.json, a clean version of the Alpaca dataset made at Stanford.
An earlier version used Facebook's NLLB 1.3B model, but the current version uses OpenAI's gpt-3.5-turbo, hence this dataset cannot be used to create models that compete in any way against OpenAI.
mc4-samplingA sampling-enabled version of mC4, the colossal, cleaned version of Common Crawl's web crawl corpus.
Based on Common Crawl dataset: "https://commoncrawl.org".
This is a version of the processed version of Google's mC4 dataset by AllenAI, in which sampling methods are implemented to perform on the fly.details_bertin-project__bertin-gpt-j-6B-alpaca
Dataset Card for Evaluation run of bertin-project/bertin-gpt-j-6B-alpaca
Dataset Summary
Dataset automatically created during the evaluation run of model bertin-project/bertin-gpt-j-6B-alpaca on the Open LLM Leaderboard.
The dataset is composed of 64 configuration, each one coresponding to one of the evaluated task.
The dataset has been created from 2 run(s). Each run can be found as a specific split in each configuration, the split being named using the timestamp of the… See the full description on the dataset page: https://huggingface.co/datasets/open-llm-leaderboard-old/details_bertin-project__bertin-gpt-j-6B-alpaca.zenobia-instruct-hf
Zenobia Instruct
This dataset has been extracted from alvp/zenobia and alvp/stanzas, and parsed into a huggingface-friendly format so you can use apply_chat_template as explained on the Chat Templating documentation.
Example
from transformers import AutoTokenizer
tokenizer = AutoTokenizer.from_pretrained("mistralai/Mistral-7B-Instruct-v0.1")
chat = [
{"role": "user", "content": "Escribe un terceto sobre la naturaleza en un paisaje nevado."},
{"role":… See the full description on the dataset page: https://huggingface.co/datasets/bertin-project/zenobia-instruct-hf.BOE-XSUM
BOE-XSUM Balanced Dataset - Reviewed and Cleaned
Description
The BOE 2025 Dataset is a collection of BOE articles with extreme summaries of them. This dataset has been carefully balanced and cleaned to ensure its quality and usefulness in natural language processing (NLP) tasks, primarily for evaluating generative models.
Read more in https://arxiv.org/abs/2509.24908
Dataset Content
The dataset is composed of the following subsets (splits):
train: Training… See the full description on the dataset page: https://huggingface.co/datasets/bertin-project/BOE-XSUM.