navit
Datasets
All datasets matching “navit”NaviTrace
Dataset Card for NaviTrace
NaviTrace is a Visual Question Answering benchmark for evaluating how well vision-language models (VLMs) understand embodiment-specific navigation in real-world scenes. Each sample presents a first-person image of an outdoor environment paired with a natural language navigation instruction. The task is to predict a 2D navigation trace — a sequence of waypoints in image space — that a given embodiment type would follow to complete the instruction.
The… See the full description on the dataset page: https://huggingface.co/datasets/Voxel51/NaviTrace.navitrace
NaviTrace
🏠 Project
📄 Paper
💻 Code
🏆 Leaderboard
NaviTrace is a novel VQA benchmark for VLMs that evaluates models on their embodiment-specific understanding of navigation across challenging real-world scenarios.
Key Features
✏️ Core Task: Given a real-world image in first-person perspective, a language instruction, and an embodiment type, models should predict… See the full description on the dataset page: https://huggingface.co/datasets/leggedrobotics/navitrace.mmlu
Dataset Card for MMLU
Dataset Summary
Measuring Massive Multitask Language Understanding by Dan Hendrycks, Collin Burns, Steven Basart, Andy Zou, Mantas Mazeika, Dawn Song, and Jacob Steinhardt (ICLR 2021).
This is a massive multitask test consisting of multiple-choice questions from various branches of knowledge. The test spans subjects in the humanities, social sciences, hard sciences, and other areas that are important for some people to learn. This covers 57 tasks… See the full description on the dataset page: https://huggingface.co/datasets/navitrix/mmlu.traffic-anomaly-dbOpus-4.6-Reasoning-3000x-filteredFiltered from: https://huggingface.co/datasets/crownelius/Opus-4.6-Reasoning-3000x
The original dataset has 979 refusals, I removed these in this version.