datasets
Training and evaluation data, with the modality, task and licence stated up front. Listed live from the Hugging Face Hub.
croissant_dataset_no_web_data
CroissantLLM: A Truly Bilingual French-English Language Model
Dataset
Ressources are currently being uploaded !
https://arxiv.org/abs/2402.00786
Licenses
Data redistributed here is subject to the original license under which it was collected. All license information is detailed in the Data section of the Technical report.
Citation
@misc{faysse2024croissantllm,
title={CroissantLLM: A Truly Bilingual French-English Language Model}… See the full description on the dataset page: https://huggingface.co/datasets/croissantllm/croissant_dataset_no_web_data.open-web-math-minhash
Dataset Card for "open-web-math-minhash"
An attempt at a "high quality sample" of open-web-math/open-web-math by aggressively applying minhash from text-dedup. The result is 1.82M rows down from the original 6M:
DatasetDict({
train: Dataset({
features: ['url', 'text', 'date', 'metadata'],
num_rows: 1820241
})
})
Usage
Unless you need the metadata, load the text-only config which is only 1.4 GB/5 shards:
from datasets import load_dataset… See the full description on the dataset page: https://huggingface.co/datasets/BEE-spoke-data/open-web-math-minhash.task1728_web_nlg_data_to_text
Dataset Card for Natural Instructions (https://github.com/allenai/natural-instructions) Task: task1728_web_nlg_data_to_text
Additional Information
Citation Information
The following paper introduces the corpus in detail. If you use the corpus in published work, please cite it:
@misc{wang2022supernaturalinstructionsgeneralizationdeclarativeinstructions,
title={Super-NaturalInstructions: Generalization via Declarative Instructions on 1600+ NLP Tasks}… See the full description on the dataset page: https://huggingface.co/datasets/Lots-of-LoRAs/task1728_web_nlg_data_to_text.Softcatala-Web-Texts-Dataset
Dataset Card for Softcatala-Web-Texts-Dataset
Dataset Summary
This repository contains Softcatala website content (articles and programs descriptions).
Dataset size:
articles.json contains 623 articles with 373233 words.
programes.json contains 330 program descriptions with 49868 words.
The license of the data is Attribution-ShareAlike 4.0 International (CC BY-SA 4.0) or Universal Public Domain Dedication (CC0 1.0)
Supported Tasks and Leaderboards… See the full description on the dataset page: https://huggingface.co/datasets/softcatala/Softcatala-Web-Texts-Dataset.gui_actor_webdataset
GUI-Actor WebDataset
A WebDataset format version of the GUI-Actor dataset for training vision-language models on GUI interaction tasks.
Usage
import webdataset as wds
# Load the dataset
dataset = wds.WebDataset("path/to/shards-*.tar")
dataset = dataset.decode("pilrgb").to_tuple("jpg", "json")
for image, metadata in dataset:
# Process image and metadata
pass
Citation
Please cite the original GUI-Actor paper if you use this dataset in your research.
tool-reasoning-sft-TOOLS-toolmind-web-qa-sft-tool-use-data-cleaned-rectified-5.2k
ToolMind-Web-QA — Hermes Reasoning Format
Filtered and restructured version of Nanbeige/ToolMind-Web-QA.
Filters applied: valid role transitions only · known tools only · non-empty user + answer required
Size: 5,274 examples (from 5,624 original trajectories, 350 dropped)
Source
The original dataset contains 5,624 complex multi-hop QA trajectories grounded in Wikipedia
entity-relation graphs. Each trajectory has an average of ~138 turns with multiple tool calls
across… See the full description on the dataset page: https://huggingface.co/datasets/AmanPriyanshu/tool-reasoning-sft-TOOLS-toolmind-web-qa-sft-tool-use-data-cleaned-rectified-5.2k.Web_MD_Dataset_V0
Dataset Card for Dataset Name
Dataset Summary
This dataset card aims to be a base template for new datasets. It has been generated using this raw template.
Supported Tasks and Leaderboards
[More Information Needed]
Languages
[More Information Needed]
Dataset Structure
Data Instances
[More Information Needed]
Data Fields
[More Information Needed]
Data Splits
[More Information Needed]
Dataset Creation… See the full description on the dataset page: https://huggingface.co/datasets/Daya7624/Web_MD_Dataset_V0.