datasets
Training and evaluation data, with the modality, task and licence stated up front. Listed live from the Hugging Face Hub.
text_generation_model_data
Citation
If you use any resources included in this repository for your work, please kindly cite the following paper:
M. S. Salim, H. Murad, D. Das and F. Ahmed,
"BanglaGPT: A Generative Pretrained Transformer-Based Model for Bangla Language,"
2023 International Conference on Information and Communication Technology for Sustainable Development (ICICT4SD), Dhaka, Bangladesh, 2023, pp. 56-59, doi: 10.1109/ICICT4SD59951.2023.10303383.
keywords:… See the full description on the dataset page: https://huggingface.co/datasets/shahidul034/text_generation_model_data.llama-3-8b-self-align-data-generation-results
Llama 3 8B Self-Alignment Data Generation
This repository contains the various stages of the data generation and curation portion of the StarCoder2 Self-Alignment pipeline:
How this repository is laid out
Each revision (branch) of this repository contains one of the stages laid out in the data generation pipeline directions.
Eventually a Docker image will be hosted on the Hub that will mimic the environment used to do so, I will post this soon.Stage to branchname:… See the full description on the dataset page: https://huggingface.co/datasets/muellerzr/llama-3-8b-self-align-data-generation-results.Qwen2.5-7B-RLT-teacher_data_generation
Qwen2.5-7B-RLT Teacher Model Explanations
Dataset Description
This dataset contains data generated by the Team-Promptia/Qwen2.5-7B-RLT-teacher model. The data was created by providing the model with questions and answers from several well-known academic datasets and tasking it with generating a detailed explanation for each solution.
The primary purpose of this dataset is to evaluate the ability of the Team-Promptia/Qwen2.5-7B-RLT-teacher model to generate high-quality… See the full description on the dataset page: https://huggingface.co/datasets/Team-Promptia/Qwen2.5-7B-RLT-teacher_data_generation.argument_generation_preference_dataFallacy types mapping:
'Not a Fallacy': 0
'faulty generalization': 1
'false causality': 2
'fallacy of relevance': 3
'fallacy of extension': 4
'equivocation': 5
'ad populum': 6
'appeal to emotion': 7
'ad hominem': 8
'circular reasoning': 9
'fallacy of credibility': 10
'fallacy of logic': 11
'false dilemma': 12
'intentional': 13
sapient-synth-flan-niv2-fsopt-data-task635-allegro-reviews-answer-generation
sapient-synth-flan-niv2-fsopt-data-task635-allegro-reviews-answer-generation
Chat-template-ready synthetic anonymous replacement examples for one Sapient source excluded from the DFM5 data mix.
Contents
Format: gzip-compressed JSON Lines under data/train.jsonl.gz
Schema: {"messages": [{"role": "user", "content": "..."}, {"role": "assistant", "content": "..."}]}
Files: 1
Rows: 3186
Task: synthetic anonymous instruction replacement
Generation
Rows… See the full description on the dataset page: https://huggingface.co/datasets/schneiderkamplab/sapient-synth-flan-niv2-fsopt-data-task635-allegro-reviews-answer-generation.Qwen2.5-7B-RLT-math-expert_data_generationsapient-synth-flan-niv2-zsopt-data-task618-amazonreview-summary-text-generation
sapient-synth-flan-niv2-zsopt-data-task618-amazonreview-summary-text-generation
Chat-template-ready synthetic anonymous replacement examples for one Sapient source excluded from the DFM5 data mix.
Contents
Format: gzip-compressed JSON Lines under data/train.jsonl.gz
Schema: {"messages": [{"role": "user", "content": "..."}, {"role": "assistant", "content": "..."}]}
Files: 1
Rows: 4896
Task: synthetic anonymous instruction replacement
Generation… See the full description on the dataset page: https://huggingface.co/datasets/schneiderkamplab/sapient-synth-flan-niv2-zsopt-data-task618-amazonreview-summary-text-generation.sapient-synth-flan-niv2-fsopt-data-task870-msmarco-answer-generation
sapient-synth-flan-niv2-fsopt-data-task870-msmarco-answer-generation
Chat-template-ready synthetic anonymous replacement examples for one Sapient source excluded from the DFM5 data mix.
Contents
Format: gzip-compressed JSON Lines under data/train.jsonl.gz
Schema: {"messages": [{"role": "user", "content": "..."}, {"role": "assistant", "content": "..."}]}
Files: 1
Rows: 1226
Task: synthetic anonymous instruction replacement
Generation
Rows were… See the full description on the dataset page: https://huggingface.co/datasets/schneiderkamplab/sapient-synth-flan-niv2-fsopt-data-task870-msmarco-answer-generation.sapient-synth-flan-niv2-fsopt-data-task589-amazonfood-summary-text-generation
sapient-synth-flan-niv2-fsopt-data-task589-amazonfood-summary-text-generation
Chat-template-ready synthetic anonymous replacement examples for one Sapient source excluded from the DFM5 data mix.
Contents
Format: gzip-compressed JSON Lines under data/train.jsonl.gz
Schema: {"messages": [{"role": "user", "content": "..."}, {"role": "assistant", "content": "..."}]}
Files: 1
Rows: 11860
Task: synthetic anonymous instruction replacement
Generation
Rows… See the full description on the dataset page: https://huggingface.co/datasets/schneiderkamplab/sapient-synth-flan-niv2-fsopt-data-task589-amazonfood-summary-text-generation.sapient-synth-flan-niv2-fsopt-data-task618-amazonreview-summary-text-generation
sapient-synth-flan-niv2-fsopt-data-task618-amazonreview-summary-text-generation
Chat-template-ready synthetic anonymous replacement examples for one Sapient source excluded from the DFM5 data mix.
Contents
Format: gzip-compressed JSON Lines under data/train.jsonl.gz
Schema: {"messages": [{"role": "user", "content": "..."}, {"role": "assistant", "content": "..."}]}
Files: 1
Rows: 11879
Task: synthetic anonymous instruction replacement
Generation… See the full description on the dataset page: https://huggingface.co/datasets/schneiderkamplab/sapient-synth-flan-niv2-fsopt-data-task618-amazonreview-summary-text-generation.sapient-synth-flan-niv2-zsopt-data-task589-amazonfood-summary-text-generation
sapient-synth-flan-niv2-zsopt-data-task589-amazonfood-summary-text-generation
Chat-template-ready synthetic anonymous replacement examples for one Sapient source excluded from the DFM5 data mix.
Contents
Format: gzip-compressed JSON Lines under data/train.jsonl.gz
Schema: {"messages": [{"role": "user", "content": "..."}, {"role": "assistant", "content": "..."}]}
Files: 1
Rows: 5311
Task: synthetic anonymous instruction replacement
Generation
Rows… See the full description on the dataset page: https://huggingface.co/datasets/schneiderkamplab/sapient-synth-flan-niv2-zsopt-data-task589-amazonfood-summary-text-generation.sapient-synth-flan-niv2-zsopt-data-task635-allegro-reviews-answer-generation
sapient-synth-flan-niv2-zsopt-data-task635-allegro-reviews-answer-generation
Chat-template-ready synthetic anonymous replacement examples for one Sapient source excluded from the DFM5 data mix.
Contents
Format: gzip-compressed JSON Lines under data/train.jsonl.gz
Schema: {"messages": [{"role": "user", "content": "..."}, {"role": "assistant", "content": "..."}]}
Files: 1
Rows: 2120
Task: synthetic anonymous instruction replacement
Generation
Rows… See the full description on the dataset page: https://huggingface.co/datasets/schneiderkamplab/sapient-synth-flan-niv2-zsopt-data-task635-allegro-reviews-answer-generation.sapient-synth-flan-niv2-zsopt-data-task870-msmarco-answer-generation
sapient-synth-flan-niv2-zsopt-data-task870-msmarco-answer-generation
Chat-template-ready synthetic anonymous replacement examples for one Sapient source excluded from the DFM5 data mix.
Contents
Format: gzip-compressed JSON Lines under data/train.jsonl.gz
Schema: {"messages": [{"role": "user", "content": "..."}, {"role": "assistant", "content": "..."}]}
Files: 1
Rows: 581
Task: synthetic anonymous instruction replacement
Generation
Rows were… See the full description on the dataset page: https://huggingface.co/datasets/schneiderkamplab/sapient-synth-flan-niv2-zsopt-data-task870-msmarco-answer-generation.Qwen2.5-7B-RLT-physics_chemistry-expert_data_generationsapient-synth-flan-niv2-fsopt-data-task871-msmarco-question-generation
sapient-synth-flan-niv2-fsopt-data-task871-msmarco-question-generation
Chat-template-ready synthetic anonymous replacement examples for one Sapient source excluded from the DFM5 data mix.
Contents
Format: gzip-compressed JSON Lines under data/train.jsonl.gz
Schema: {"messages": [{"role": "user", "content": "..."}, {"role": "assistant", "content": "..."}]}
Files: 1
Rows: 158
Task: synthetic anonymous instruction replacement
Generation
Rows were… See the full description on the dataset page: https://huggingface.co/datasets/schneiderkamplab/sapient-synth-flan-niv2-fsopt-data-task871-msmarco-question-generation.Qwen2.5-7B-RLT-medicine_biology-expert_data_generationsapient-synth-flan-niv2-zsopt-data-task871-msmarco-question-generation
sapient-synth-flan-niv2-zsopt-data-task871-msmarco-question-generation
Chat-template-ready synthetic anonymous replacement examples for one Sapient source excluded from the DFM5 data mix.
Contents
Format: gzip-compressed JSON Lines under data/train.jsonl.gz
Schema: {"messages": [{"role": "user", "content": "..."}, {"role": "assistant", "content": "..."}]}
Files: 1
Rows: 89
Task: synthetic anonymous instruction replacement
Generation
Rows were… See the full description on the dataset page: https://huggingface.co/datasets/schneiderkamplab/sapient-synth-flan-niv2-zsopt-data-task871-msmarco-question-generation.