Datasetpublic

Eviezonr08/logicwaver-reasoning-v1

LogicWaver Adversarial Reasoning Benchmark Adversarial Semantic Reasoning Benchmark — 20 handcrafted odd-one-out puzzles where SOTA LLMs fail but humans succeed. For LLM evaluation & Chain-of-Thought probing. 🚀 Live Demo: https://huggingface.co/spaces/Eviezonr08/logicwaver-demo ▶️ Try 20 puzzles interactively - no install! Files Reasoning_Puzzle_without_proline.csv — 20 puzzles for evaluation with_proline/Reasoning_Puzzle_proline.csv — Same 20 + pro_line… See the full description on the dataset page: https://huggingface.co/datasets/Eviezonr08/logicwaver-reasoning-v1.

sourceHugging Facemitupdated 1mo agoView on Hugging Face

0likes18downloads

Dataset Card

LogicWaver Adversarial Reasoning Benchmark

Adversarial Semantic Reasoning Benchmark — 20 handcrafted odd-one-out puzzles where SOTA LLMs fail but humans succeed. For LLM evaluation & Chain-of-Thought probing.

🚀 Live Demo: https://huggingface.co/spaces/Eviezonr08/logicwaver-demo

▶️ Try 20 puzzles interactively - no install!

Files

—Reasoning_Puzzle_without_proline.csv — 20 puzzles for evaluation
—with_proline/Reasoning_Puzzle_proline.csv — Same 20 + pro_line reasoning traces

Example

Q: Which one does NOT belong in the same group? Cookies / School-days / Rock / Queen / Freezer A: School days explanation: Other 4 are single-word objects, School days is a 2-word time period.

Use

python

from datasets import load_dataset
ds = load_dataset("Eviezonr08/logicwaver-reasoning-v1")