datasets
Training and evaluation data, with the modality, task and licence stated up front. Listed live from the Hugging Face Hub.
databricks-dolly-15k-curated-en
Guidelines
In this dataset, you will find a collection of records that show a category, an instruction, a context and a response to that instruction. The aim of the project is to correct the instructions, intput and responses to make sure they are of the highest quality and that they match the task category that they belong to. All three texts should be clear and include real information. In addition, the response should be as complete but concise as possible.
To curate the dataset… See the full description on the dataset page: https://huggingface.co/datasets/argilla/databricks-dolly-15k-curated-en.databricks_dolly_15k
Dataset Card for Dolly_15K
Summary
databricks-dolly-15k is an open source dataset of instruction-following records generated by thousands of Databricks employees in several of the behavioral categories outlined in the InstructGPT paper, including brainstorming, classification, closed QA, generation, information extraction, open QA, and summarization.
This dataset can be used for any purpose, whether academic or commercial, under the terms of the Creative Commons… See the full description on the dataset page: https://huggingface.co/datasets/HuggingFaceH4/databricks_dolly_15k.databricks-dolly-15k-curated-multilingual
Dataset Card for "databricks-dolly-15k-curated-multilingual"
A curated and multilingual version of the Databricks Dolly instructions dataset. It includes a programmatically and manually corrected version of the original en dataset. See below.
STATUS:
Currently, the original Dolly v2 English version has been curated combining automatic processing and collaborative human curation using Argilla (~400 records have been manually edited and fixed). The following graph shows a summary… See the full description on the dataset page: https://huggingface.co/datasets/argilla/databricks-dolly-15k-curated-multilingual.databricks-qa-ja
License & Attribution
MTEB-format derivative of yulanfmy/databricks-qa-ja (Japanese Databricks/Dolly-style technical QA). Query = question; corpus = answer. Licensed under CC-BY-SA-3.0 (same as source).
databricks_dolly_15k
Databricks Dolly task samples
Standalone task subsets derived from
databricks/databricks-dolly-15k at
revision bdd27f4d94b9c1f951818a7da7fd7aeea5dbff1a:
general_qa (source category: general_qa)
open_qa (source category: open_qa)
closed_qa (source category: closed_qa)
brainstorm (source category: brainstorming)
classify (source category: classification)
extract_information (source category: information_extraction)
summarize (source category: summarization)
creative_writing… See the full description on the dataset page: https://huggingface.co/datasets/Alberto1231/databricks_dolly_15k.databricks_dolly15k_enLlama-2-databricks-dolly-oasst1-es-lower-1024-tokens
Llama-2-databricks-dolly-oasst1-es-lower-1024-tokens
Union of https://huggingface.co/datasets/dariolopez/Llama-2-databricks-dolly-es and https://huggingface.co/datasets/dariolopez/Llama-2-oasst1-es
Filtering of texts with less than 1024 tokens.
databricks-dolly-15k-Hinglish-Codemix
Summary
aaditya/databricks-dolly-15k-Hindi is an open source Hinglish-Codemix version dataset of databricks/databricks-dolly-15k.
This dataset can be used for any purpose, whether academic or commercial, under the terms of the
Creative Commons Attribution-ShareAlike 3.0 Unported License.
Supported Tasks:
Training LLMs
Synthetic Data Generation
Data Augmentation
Languages: Hindi
Version: 1.0
Original Dataset repo… See the full description on the dataset page: https://huggingface.co/datasets/aaditya/databricks-dolly-15k-Hinglish-Codemix.databricks-dolly-15k-urThis dataset was created by translating "databricks-dolly-15k.jsonl" into Urdu. It is licensed under CC BY 3.0.
.اس ڈیٹا سیٹ کو "ڈیٹابرکس-ڈولی" کو اردو میں ترجمہ کرکے تیار کیا گیا تھا
databricks-dolly-15k https://github.com/databrickslabs/dolly/tree/master/data
databricks_dolly_15k
Dataset Card for Dolly_15K
Summary
databricks-dolly-15k is an open source dataset of instruction-following records generated by thousands of Databricks employees in several of the behavioral categories outlined in the InstructGPT paper, including brainstorming, classification, closed QA, generation, information extraction, open QA, and summarization.
This dataset can be used for any purpose, whether academic or commercial, under the terms of the Creative Commons… See the full description on the dataset page: https://huggingface.co/datasets/nahsa/databricks_dolly_15k.databricks-dolly-15k-ja-alpaca-formatThis dataset is a translation of "databricks-dolly-15k-ja", which was created by automatically translating "databricks-dolly-15k" into Japanese, into input and output formats.
This dataset is licensed under CC BY SA 3.0
Last Update : 2023-06-15
databricks-dolly-15k-ja
https://github.com/kunishou/databricks-dolly-15k-ja
databricks-dolly-15k
https://github.com/databrickslabs/dolly/tree/master/data
databricks-databricks-dolly-15kChatML-databricks-dolly-15kdatabricks/databricks-dolly-15k in ChatML format.
Python code used for conversion:
from datasets import load_dataset
import pandas
from transformers import AutoTokenizer
tokenizer = AutoTokenizer.from_pretrained(
pretrained_model_name_or_path="Felladrin/Llama-160M-Chat-v1"
)
dataset = load_dataset("databricks/databricks-dolly-15k", split="train")
def format(columns):
instruction = columns["instruction"].strip()
context = columns["context"].strip()
response =… See the full description on the dataset page: https://huggingface.co/datasets/Felladrin/ChatML-databricks-dolly-15k.Llama-2-databricks-dolly-oasst1-es-lower-512-tokens
Llama-2-databricks-dolly-oasst1-es-lower-512-tokens
Union of https://huggingface.co/datasets/dariolopez/Llama-2-databricks-dolly-es and https://huggingface.co/datasets/dariolopez/Llama-2-oasst1-es
Filtering of texts with less than 512 tokens.
databricks-dolly-15k-es-deepl
Dataset Card for "databricks-dolly-15k-es-deepl"
More Information needed
edition_0308_argilla-databricks-dolly-15k-curated-en-readymade
edition_0308_argilla-databricks-dolly-15k-curated-en-readymade
A Readymade by TheFactoryX
Original Dataset
argilla/databricks-dolly-15k-curated-en
Process
This dataset is a "readymade" - inspired by Marcel Duchamp's concept of taking everyday objects and recontextualizing them as art.
What we did:
Selected the original dataset from Hugging Face
Shuffled each column independently
Destroyed all row-wise relationships
Preserved structure, removed meaning
The… See the full description on the dataset page: https://huggingface.co/datasets/TheFactoryX/edition_0308_argilla-databricks-dolly-15k-curated-en-readymade.databricks-dolly-15k-th
Summary
This is a Thai 🇹🇭-instructed dataset translated from databricks-dolly-15k using Google Cloud Translation.
databricks-dolly-15k is an open-source dataset of instruction-following records generated by thousands of Databricks employees in several behavioral
categories outlined in the InstructGPT paper, including brainstorming, classification, closed QA, generation, information extraction, open QA, and summarization.
This dataset can be used for any purpose, whether academic… See the full description on the dataset page: https://huggingface.co/datasets/Thaweewat/databricks-dolly-15k-th.databricks-dolly15k-semantic-complexity
Databricks - Dolly 15k – Enriched Variant (Instruction-Tuned with Semantic and Complexity Augmentation)
Overview
This dataset is a semantically enriched and complexity-aware extension of the original Databricks Dolly 15k, purpose-built for evaluating and training instruction-following models. Each sample is augmented with additional signals to enable more nuanced filtering, curriculum learning, and benchmark development across diverse NLP tasks.
Dataset Format
Each… See the full description on the dataset page: https://huggingface.co/datasets/GenAIDevTOProd/databricks-dolly15k-semantic-complexity.databricks-dolly-15k-tamildatabricks-dolly-15k-askllm-v1
databricks-dolly-15k-askllm-v1
データセット databricks/databricks-dolly-15k に対して、 Ask-LLM 手法でスコア付けしたデータセットです。
元データセットのカラムに加え askllm_score というカラムが追加されており、ここに Ask-LLM のスコアが格納されています。
Ask-LLM でスコア付けに使用した LLM は Rakuten/RakutenAI-7B-instruct で、プロンプトは以下の通りです。
###
{data}
###
Does the previous paragraph demarcated within ### and ### contain informative signal for pre-training a large-language model? An informative datapoint should be well-formatted, contain some usable knowledge of the world, and… See the full description on the dataset page: https://huggingface.co/datasets/geniacllm/databricks-dolly-15k-askllm-v1.Llama-2-databricks-dolly-oasst1-es-lower-2048-tokens
Llama-2-databricks-dolly-oasst1-es-lower-2048-tokens
Union of https://huggingface.co/datasets/dariolopez/Llama-2-databricks-dolly-es and https://huggingface.co/datasets/dariolopez/Llama-2-oasst1-es
Filtering of texts with less than 2048 tokens.
edition_0197_argilla-databricks-dolly-15k-curated-en-readymade
edition_0197_argilla-databricks-dolly-15k-curated-en-readymade
A Readymade by TheFactoryX
Original Dataset
argilla/databricks-dolly-15k-curated-en
Process
This dataset is a "readymade" - inspired by Marcel Duchamp's concept of taking everyday objects and recontextualizing them as art.
What we did:
Selected the original dataset from Hugging Face
Shuffled each column independently
Destroyed all row-wise relationships
Preserved structure, removed meaning
The… See the full description on the dataset page: https://huggingface.co/datasets/TheFactoryX/edition_0197_argilla-databricks-dolly-15k-curated-en-readymade.databricks-dolly-15k-Hindi
Summary
aaditya/databricks-dolly-15k-Hindi is an open source Hindi version dataset of databricks/databricks-dolly-15k.
This dataset can be used for any purpose, whether academic or commercial, under the terms of the
Creative Commons Attribution-ShareAlike 3.0 Unported License.
Supported Tasks:
Training LLMs
Synthetic Data Generation
Data Augmentation
Languages: Hindi
Version: 1.0
Original Dataset repo… See the full description on the dataset page: https://huggingface.co/datasets/aaditya/databricks-dolly-15k-Hindi.edition_0222_argilla-databricks-dolly-15k-curated-en-readymade
edition_0222_argilla-databricks-dolly-15k-curated-en-readymade
A Readymade by TheFactoryX
Original Dataset
argilla/databricks-dolly-15k-curated-en
Process
This dataset is a "readymade" - inspired by Marcel Duchamp's concept of taking everyday objects and recontextualizing them as art.
What we did:
Selected the original dataset from Hugging Face
Shuffled each column independently
Destroyed all row-wise relationships
Preserved structure, removed meaning
The… See the full description on the dataset page: https://huggingface.co/datasets/TheFactoryX/edition_0222_argilla-databricks-dolly-15k-curated-en-readymade.edition_0723_argilla-databricks-dolly-15k-curated-en-readymade
edition_0723_argilla-databricks-dolly-15k-curated-en-readymade
A Readymade by TheFactoryX
Original Dataset
argilla/databricks-dolly-15k-curated-en
Process
This dataset is a "readymade" - inspired by Marcel Duchamp's concept of taking everyday objects and recontextualizing them as art.
What we did:
Selected the original dataset from Hugging Face
Shuffled each column independently
Destroyed all row-wise relationships
Preserved structure, removed meaning
The… See the full description on the dataset page: https://huggingface.co/datasets/TheFactoryX/edition_0723_argilla-databricks-dolly-15k-curated-en-readymade.databricks-dolly-1kThis is a subset (1000 samples) of databricks/databricks-dolly-15k dataset, processed to match Mistral-7B-instruct-v0.2's prompt format. It was created using the colab notebook.
databricks-dolly-15kedition_0787_argilla-databricks-dolly-15k-curated-en-readymade
edition_0787_argilla-databricks-dolly-15k-curated-en-readymade
A Readymade by TheFactoryX
Original Dataset
argilla/databricks-dolly-15k-curated-en
Process
This dataset is a "readymade" - inspired by Marcel Duchamp's concept of taking everyday objects and recontextualizing them as art.
What we did:
Selected the original dataset from Hugging Face
Shuffled each column independently
Destroyed all row-wise relationships
Preserved structure, removed meaning
The… See the full description on the dataset page: https://huggingface.co/datasets/TheFactoryX/edition_0787_argilla-databricks-dolly-15k-curated-en-readymade.databricks-dolly-15k-ja-reformat-v1This is a reformatted version of kunishou/databricks-dolly-15k-ja.
If you use this dataset, please cite the original dataset as well.
edition_0660_argilla-databricks-dolly-15k-curated-en-readymade
edition_0660_argilla-databricks-dolly-15k-curated-en-readymade
A Readymade by TheFactoryX
Original Dataset
argilla/databricks-dolly-15k-curated-en
Process
This dataset is a "readymade" - inspired by Marcel Duchamp's concept of taking everyday objects and recontextualizing them as art.
What we did:
Selected the original dataset from Hugging Face
Shuffled each column independently
Destroyed all row-wise relationships
Preserved structure, removed meaning
The… See the full description on the dataset page: https://huggingface.co/datasets/TheFactoryX/edition_0660_argilla-databricks-dolly-15k-curated-en-readymade.