Apppublic

thamilvendhan/signalbench

sourceHugging Faceapache-2.0updated 2mo agoView on Hugging Face

0likes

App README

signalbench leaderboard — In-Band Signal Compliance (IBSC)

Central leaderboard for the signalbench benchmark: one metric (Signal-Response Correctness) that unifies over-compliance (prompt injection) and under-compliance (temporal blindness, access-deny, memory-label leaks, bot-policy) for LLM agents across 21 systems.

—Code / harness: https://github.com/mthamil107/signal-compliance
—Dataset + raw responses: https://huggingface.co/datasets/thamilvendhan/signalbench
—DOI: https://doi.org/10.5281/zenodo.21223956

Data is bundled in leaderboard.csv; regenerate from results via scripts/gen_community_evals.py sibling tooling in the code repo.