datasets
Training and evaluation data, with the modality, task and licence stated up front. Listed live from the Hugging Face Hub.
Nemotron-CC-HQ-20B
Nemotron-CC-HQ-20B
This Dataset consists of approximately 20B tokens of Nemotron-CC-HQ, consisting of randomly sampled slices from crawls in the range CC-MAIN-2013-20-part-00012 to CC-MAIN-2019-04-part-00007.
For more information about Nemotron-CC check the Paper by Nvidia
Disclaimer:
Derived from Nemotron-CC (Common Crawl). No ownership of underlying content is claimed.
Data may be subject to third-party rights. Use at your own risk and in compliance with… See the full description on the dataset page: https://huggingface.co/datasets/Fredithefish/Nemotron-CC-HQ-20B.LuxAlign
Dataset Card for LuxAlign
Loading the Dataset
The dataset is currently at version v3, which can be loaded as:
from datasets import load_dataset
ds = load_dataset("fredxlpy/LuxAlign", name="lb-en") # or "lb-fr"
If you want to reproduce the results from the paper (v1) or use any previous version, you can specify the version folder:
# Load version v1 (as used in the paper)
ds_v1 = load_dataset("fredxlpy/LuxAlign", data_dir="data/v1", data_files={"train": "lb_en.json"})… See the full description on the dataset page: https://huggingface.co/datasets/fredxlpy/LuxAlign.ParaLux
Dataset Card for ParaLux Benchmark
Dataset Summary
ParaLux is a Luxembourgish paraphrase detection benchmark that requires models to identify the correct paraphrase from two candidates for a given anchor sentence: one representing a valid paraphrase and the other an adversarial not_paraphrase. The dataset, consisting of 312 examples, is sourced from news articles published by RTL.lu and was introduced in LuxEmbedder: A Cross-Lingual Approach to Enhanced Luxembourgish… See the full description on the dataset page: https://huggingface.co/datasets/fredxlpy/ParaLux.FREDLETZ
Dataset Card for Luxembourgish Entailment-based Topic classification via Zero-shot learning (LETZ)
Dataset Summary
The datasets for Luxembourgish Entailment-based Topic classification via Zero-shot learning (LETZ) can be used to adapt language models to zero-shot classification in Luxembourgish. It leverages data from the Luxembourg Online Dictionary to provide relevant topic classification examples in Luxembourgish. The LETZ datasets were created to address the… See the full description on the dataset page: https://huggingface.co/datasets/fredxlpy/LETZ.FREDSum
Dataset Summary
The FREDSum dataset is a comprehensive collection of transcripts and metadata from various political and public debates in France. The dataset aims to provide researchers, linguists, and data scientists with a rich source of debate content for analysis and natural language processing tasks.
Languages
French
Dataset Structure
The dataset is made of 144 debates, 115 of the debates make up the train set, while 29 make up the test set
Data… See the full description on the dataset page: https://huggingface.co/datasets/linagora/FREDSum.FRED-SemBench
FRED-SemBench
FRED-SemBench is a 200-question benchmark candidate for evaluating whether LLM
agents retrieve macroeconomic answers with the intended concept, series,
transformation, unit, observation period, and data-vintage semantics.
This dataset accompanies the FinNLP 2026 paper
“FRED-SemBench: Evaluating Semantic Reliability in LLM Access to
Macroeconomic Data”
by Wilson Wang, Chandler Han, and Peter Zhang (Kairos-AI).
Status and scope
50 independently… See the full description on the dataset page: https://huggingface.co/datasets/wangjinh/FRED-SemBench.TGFilesatlas-biblica
Atlas Biblica — open reference data
🌍 atlasbiblica.com · 💾 GitHub · 📖 CC BY 4.0
Homepage: https://atlasbiblica.com
Repository: https://github.com/Gutenback/atlas-biblica-data
Point of contact: Fred Guth
Structured reference data about the people, places and names of the Bible. It is the open half of
the data behind Atlas Biblica, a free reference to the people,
places, events and books of the Bible.
Every record carries atlas_url, the canonical address of its… See the full description on the dataset page: https://huggingface.co/datasets/fredguth/atlas-biblica.ShareGPT-Unfiltered-RedPajama-Chat-format
ShareGPT unfiltered dataset in RedPajama-Chat format
This dataset was created by converting The alpaca-lora formatted ShareGPT dataset to the format required by RedPajama-Chat.
This script was used for the conversion: https://github.com/fredi-python/Alpaca2INCITE-Dataset-Converter/blob/main/convert.py
WARNING: Only the first human and gpt text of each conversation from the original dataset is included in the dataset.
The format
{"text": "<human>: hello\n<bot>: Hello!… See the full description on the dataset page: https://huggingface.co/datasets/Fredithefish/ShareGPT-Unfiltered-RedPajama-Chat-format.Instruction-Tuning-with-GPT-4-RedPajama-Chat
Instruction Tuning with GPT 4 RedPajama-Chat
This dataset has been converted from the Instruction-Tuning-with-GPT-4 dataset for the purpose of fine-tuning the RedPajama-INCITE-Chat-3B-v1 model.
About Instruction-Tuning-with-GPT-4
English Instruction-Following Data generated by GPT-4 using Alpaca prompts for fine-tuning LLMs.
Usage and License Notices
The data is intended and licensed for research use only. The dataset is CC BY NC 4.0 (allowing only… See the full description on the dataset page: https://huggingface.co/datasets/Fredithefish/Instruction-Tuning-with-GPT-4-RedPajama-Chat.Kronos-Dataset
Kronos-Dataset
It is a collection of various datasets to expand the capabilities of reasoning models in agent tasks, medical reasoning, multilingual thinking, and writing. All of these are unified in a single format:
[
{
"from": "system",
"value": "You are a medical AI assistant with advanced reasoning capabilities. Provide detailed, step-by-step analysis for medical questions."
},
{
"from": "human",
"value": "Given the symptoms of sudden weakness in the left arm and leg, recent… See the full description on the dataset page: https://huggingface.co/datasets/FredyRivera-dev/Kronos-Dataset.openassistant-guanaco-unfiltered
Guanaco-Unfiltered
Any language other than English, German, French, or Spanish has been removed.
Refusals of assistance have been removed.
The identification as OpenAssistant has been removed.
Version 2 is out
Identification as OpenAssistant is now fully removed
other improvements
Reddit-TIFUreap-agent-code
reap-agent-code
Dataset Summary
reap-agent-code is a REAP-style mixed dataset for training LLM coding agents.
It is optimized for agentic coding behavior: writing code, debugging, and tool use.
Each row is JSONL with the schema:
{"text": "..."}
Dataset Composition
Source
Ratio
Count
Signal
evol
45%
9 000
Instruction-to-code
swe
25%
5 000
Bug-fix / problem-solving
xlam
30%
6 000Tool / function calling
Total: 20 000 unique deduplicated… See the full description on the dataset page: https://huggingface.co/datasets/freddm/reap-agent-code.SPAG-selfplayData for the SPAG approach created by Linear95
LuxAlign_v1
Dataset Card for LuxAlign
Updates
⚠️ A newer version of this dataset is available.Although this is the original dataset described in the paper, a revised version of the dataset is available at https://huggingface.co/datasets/fredxlpy/LuxAlign.
Dataset Summary
LuxAlign is a parallel dataset featuring Luxembourgish-English and Luxembourgish-French sentence pairs, introduced in LuxEmbedder: A Cross-Lingual Approach to Enhanced Luxembourgish Sentence Embeddings… See the full description on the dataset page: https://huggingface.co/datasets/fredxlpy/LuxAlign_v1.evol-codealpaca-v1
Evolved codealpaca
Updates:
2023/08/26 - Filtered results now only contain pure english instruction and removed any mentioned of trained by OAI response
Median sequence length : 471
We employed a methodology similar to that of WizardCoder, with the exception that ours is open-source. We used the gpt-4-0314 and gpt-4-0613 models to augment and answer each response, with the bulk of generation handled by gpt-4-0314.
The aim of this dataset is twofold: firstly, to facilitate the… See the full description on the dataset page: https://huggingface.co/datasets/freddm/evol-codealpaca-v1.new_saving_json_3
Dataset Card for Dataset Name
Dataset Summary
[More Information Needed]
Supported Tasks and Leaderboards
[More Information Needed]
Languages
[More Information Needed]
Dataset Structure
Data Instances
[More Information Needed]
Data Fields
[More Information Needed]
Data Splits
[More Information Needed]
Dataset Creation
Curation Rationale
[More Information Needed]
Source Data… See the full description on the dataset page: https://huggingface.co/datasets/freddyaboulton/new_saving_json_3.ShareGPT-unfiltered-alpaca-lora-formatdataset_json_52048_FREDSUM_ABS3Qwen3.5-reasoning-700x
Dataset Card (Qwen3.5-reasoning-700x)
Dataset Summary
Qwen3.5-reasoning-700x is a high-quality distilled dataset.
This dataset uses the high-quality instructions constructed by Alibaba-Superior-Reasoning-Stage2 as the seed question set. By calling the latest Qwen3.5-27B full-parameter model on the Alibaba Cloud DashScope platform as the teacher model, it generates high-quality responses featuring long-text reasoning processes (Chain-of-Thought). It covers several major… See the full description on the dataset page: https://huggingface.co/datasets/freddm/Qwen3.5-reasoning-700x.chatinterface_callback_2claude-4.5-opus-high-reasoning-250xThis is a reasoning dataset created using Claude Opus 4.5 with a reasoning depth set to high. Some of these questions are from reedmayhew and the rest were generated.
The dataset is meant for creating distilled versions of Claude Opus 4.5 by fine-tuning already existing open-source LLMs.
Stats
Costs: $ 52.3 (USD)
Total tokens (input + output): 2.13 M
new_saving_json_7
Dataset Card for Dataset Name
Dataset Summary
[More Information Needed]
Supported Tasks and Leaderboards
[More Information Needed]
Languages
[More Information Needed]
Dataset Structure
Data Instances
[More Information Needed]
Data Fields
[More Information Needed]
Data Splits
[More Information Needed]
Dataset Creation
Curation Rationale
[More Information Needed]
Source Data… See the full description on the dataset page: https://huggingface.co/datasets/freddyaboulton/new_saving_json_7.freddy-testDette er et datasett som skal slettes.
FRED_qa_pairs_most_asked_100_questions_35paraphchatinterface_callback_3FRED-qa-pairs