datasets
Training and evaluation data, with the modality, task and licence stated up front. Listed live from the Hugging Face Hub.
mmlu-formal_logic
Dataset Card for "mmlu-formal_logic"
More Information needed
task697_mmmlu_answer_generation_formal_logic
Dataset Card for Natural Instructions (https://github.com/allenai/natural-instructions) Task: task697_mmmlu_answer_generation_formal_logic
Additional Information
Citation Information
The following paper introduces the corpus in detail. If you use the corpus in published work, please cite it:
@misc{wang2022supernaturalinstructionsgeneralizationdeclarativeinstructions,
title={Super-NaturalInstructions: Generalization via Declarative Instructions on 1600+ NLP… See the full description on the dataset page: https://huggingface.co/datasets/Lots-of-LoRAs/task697_mmmlu_answer_generation_formal_logic.FoVer-FormalLogic-FormalProof-Qwen-2.5-7B-LastStepBalanced-40kThis repository contains materials for a previous version of the paper. Please refer to the latest version.
Please refer to the LastStepBalanced Dataset section for details of this dataset.
FoVer
Project Website | 📄 Paper | 🛠️ GitHub | 🤗 Dataset | 🤗 Models
This repository includes code and materials for the paper "Efficient PRM Training Data Synthesis via Formal Verification".
Please refer to Quick Start for a quick start guide to evaluate your models on the FoVer dataset or… See the full description on the dataset page: https://huggingface.co/datasets/ryokamoi/FoVer-FormalLogic-FormalProof-Qwen-2.5-7B-LastStepBalanced-40k.formal-logic-reasoning-gliclass-2kFoVer-FormalLogic-Qwen-2.5-7BThis repository contains materials for a previous version of the paper. Please refer to the latest version.
FoVer
Project Website | 📄 Paper | 🛠️ GitHub | 🤗 Dataset | 🤗 Models
This repository includes code and materials for the paper "Efficient PRM Training Data Synthesis via Formal Verification".
Please refer to Quick Start for a quick start guide to evaluate your models on the FoVer dataset or evaluate the FoVer models on your dataset.
GitHub:… See the full description on the dataset page: https://huggingface.co/datasets/ryokamoi/FoVer-FormalLogic-Qwen-2.5-7B.mmlu-formal_logic-neg
Dataset Card for "mmlu-formal_logic-neg"
More Information needed
FoVer-FormalLogic-Llama-3.1-8BThis repository contains materials for a previous version of the paper. Please refer to the latest version.
FoVer
Project Website | 📄 Paper | 🛠️ GitHub | 🤗 Dataset | 🤗 Models
This repository includes code and materials for the paper "Efficient PRM Training Data Synthesis via Formal Verification".
Please refer to Quick Start for a quick start guide to evaluate your models on the FoVer dataset or evaluate the FoVer models on your dataset.
GitHub:… See the full description on the dataset page: https://huggingface.co/datasets/ryokamoi/FoVer-FormalLogic-Llama-3.1-8B.mmlu-formal_logic-neg-prepend
Dataset Card for "mmlu-formal_logic-neg-prepend"
More Information needed
mmlu-formal_logic-dev
Dataset Card for "mmlu-formal_logic-dev"
More Information needed
mmlu-formal_logic-rule-neg-prepend
Dataset Card for "mmlu-formal_logic-rule-neg-prepend"
More Information needed
mmlu-formal_logic-verbal-neg-prepend
Dataset Card for "mmlu-formal_logic-verbal-neg-prepend"
More Information needed
mmlu-formal_logic-original-neg
Dataset Card for "mmlu-formal_logic-original-neg"
More Information needed
mmlu-formal_logic-rule-neg
Dataset Card for "mmlu-formal_logic-rule-neg"
More Information needed
mmlu-formal_logic-original-neg-prepend
Dataset Card for "mmlu-formal_logic-original-neg-prepend"
More Information needed
mmlu-formal_logic-neg-answer
Dataset Card for "mmlu-formal_logic-neg-answer"
More Information needed
formal-logic-simple-order-new-objects-paired-bigger-5000
Dataset Card for "formal-logic-simple-order-new-objects-paired-bigger-5000"
More Information needed
FoVer-FormalLogic-FormalProof-Llama-3.1-8B-LastStepBalanced-40kThis repository contains materials for a previous version of the paper. Please refer to the latest version.
Please refer to the LastStepBalanced Dataset section for details of this dataset.
FoVer
Project Website | 📄 Paper | 🛠️ GitHub | 🤗 Dataset | 🤗 Models
This repository includes code and materials for the paper "Efficient PRM Training Data Synthesis via Formal Verification".
Please refer to Quick Start for a quick start guide to evaluate your models on the FoVer dataset or… See the full description on the dataset page: https://huggingface.co/datasets/ryokamoi/FoVer-FormalLogic-FormalProof-Llama-3.1-8B-LastStepBalanced-40k.formal-logic-reasoning-gliclassformal_logic_25kformal_logicalgo-sft-eval-traces-formal-logic-bottom-up-v4
algo-sft-eval-traces-formal-logic-bottom-up-v4
Full eval traces for algo-sft-formal-logic-bottom-up across test/harder/ood splits
Dataset Info
Rows: 2000
Columns: 11
Columns
Column
Type
Description
question_id
Value('string')
Unique question identifier from eval set
split
Value('string')
Evaluation split: test (in-distribution), harder (scaled up), ood (structural out-of-distribution)
domain
Value('string')
Task domain: formal_logic… See the full description on the dataset page: https://huggingface.co/datasets/raca-workspace-v1/algo-sft-eval-traces-formal-logic-bottom-up-v4.formal-logic-simple-order-new-objects-paired-taller-2000reasoning_with_formal_logicformal-logic-simple-order-new-objects-paired-bigger-2000
Dataset Card for "formal-logic-simple-order-new-objects-paired-bigger-2000"
More Information needed
algo-sft-eval-traces-formal-logic-bottom-up-v4
algo-sft-eval-traces-formal-logic-bottom-up-v4
Full eval traces for algo-sft-formal-logic-bottom-up across test/harder/ood splits
Dataset Info
Rows: 60
Columns: 11
Columns
Column
Type
Description
question_id
Value('string')
Unique question identifier from eval set
split
Value('string')
Evaluation split: test (in-distribution), harder (scaled up), ood (structural out-of-distribution)
domain
Value('string')
Task domain: formal_logic… See the full description on the dataset page: https://huggingface.co/datasets/zsprague/algo-sft-eval-traces-formal-logic-bottom-up-v4.formal-logic-simple-order-simple-objects-paired-blivergent-500
Dataset Card for "formal-logic-simple-order-simple-objects-paired-blivergent-500"
More Information needed
formal-logic-simple-order-new-objects-paired-lighter-2000algo-sft-eval-traces-formal-logic-distill-qwq-v4
algo-sft-eval-traces-formal-logic-distill-qwq-v4
Full eval traces for algo-sft-formal-logic-distill-qwq across test/harder/ood splits
Dataset Info
Rows: 2000
Columns: 11
Columns
Column
Type
Description
question_id
Value('string')
Unique question identifier from eval set
split
Value('string')
Evaluation split: test (in-distribution), harder (scaled up), ood (structural out-of-distribution)
domain
Value('string')
Task domain: formal_logic… See the full description on the dataset page: https://huggingface.co/datasets/raca-workspace-v1/algo-sft-eval-traces-formal-logic-distill-qwq-v4.algo-sft-eval-traces-formal-logic-truth-table-v4
algo-sft-eval-traces-formal-logic-truth-table-v4
Full eval traces for algo-sft-formal-logic-truth-table across test/harder/ood splits
Dataset Info
Rows: 2000
Columns: 11
Columns
Column
Type
Description
question_id
Value('string')
Unique question identifier from eval set
split
Value('string')
Evaluation split: test (in-distribution), harder (scaled up), ood (structural out-of-distribution)
domain
Value('string')
Task domain: formal_logic… See the full description on the dataset page: https://huggingface.co/datasets/raca-workspace-v1/algo-sft-eval-traces-formal-logic-truth-table-v4.formal-logic-simple-order-new-objects-bigger-50-2
Dataset Card for "formal-logic-simple-order-new-objects-bigger-50-2"
More Information needed
