gsarch/HStarBench-Lite
HStarBench-Lite A fixed 500-example representative/challenging subset of the 4,000-example HStarBench mixed test set, packaged for the Vero/lmms-eval panorama-strip evaluation. Selection The subset preserves the full benchmark's HOS/HPS and difficulty-level proportions: Split Level Count HOS 0 77 HOS 1 22 HOS 2 201 HPS 0 63 HPS 1 57 HPS 2 53 HPS 3 27 Within every split/level stratum, 80% is deterministic seeded sampling and 20% is a… See the full description on the dataset page: https://huggingface.co/datasets/gsarch/HStarBench-Lite.
HStarBench-Lite
A fixed 500-example representative/challenging subset of the 4,000-example HStarBench mixed test set, packaged for the Vero/lmms-eval panorama-strip evaluation.
Selection
The subset preserves the full benchmark's HOS/HPS and difficulty-level proportions:
Within every split/level stratum, 80% is deterministic seeded sampling and 20% is a hard tier based on target-cone width, angular displacement from the initial heading, polar location, and seam crossing. selection_tier identifies core versus hard.
Schema and use
The test split contains the original scoring metadata plus a panorama_strip Image column. Machine-local source paths are not included. In the accompanying lmms-eval checkout, use task hstarbench_mixed_lite_reasoning_zoom.
This is a derived benchmark subset. Consult and follow the original HStarBench terms and citation requirements when using or redistributing it.