CortexSwarm/EdgeMMEval

EdgeMMEval Minimal multimodal evaluation dataset for on-device inference testing. Covers functional correctness, accuracy, latency stress, and memory pressure across image, audio, text, multi-turn, combination, structured output, and tool-calling cases. Dataset summary The test split is defined in data/test/metadata.jsonl (200 rows). Each row has a test_id (for example IMG-001, STO-020) and a modality. Modality Samples Focus Image 34 VQA, OCR… See the full description on the dataset page: https://huggingface.co/datasets/CortexSwarm/EdgeMMEval.