omnimodal/benchmark-studio

Omnimodal Benchmark Studio

A simple local-first tool for designing any-to-any multimodal evaluation suites.

Create a benchmark in three steps:

1. 1.choose modalities
2. 2.select evaluation pathways
3. 3.define scoring dimensions and export

Supported concepts include text, image, audio, video, 3D, sensors, tools and actions.

The Space exports benchmark plans as JSON, Markdown and CSV.

No backend or API key is required.

Perceive everything. Connect meaning. Act intelligently.