vulnerability-analysis
VAB-vulnerability-analysis-benchmark
FBE and VAB
Two small benchmarks for security code analysis. Both grade without an LLM judge, so runs are cheap
and repeatable.
FBE (find-the-bug)
14 code snippets, each with one planted vulnerability. Ask the model to analyze the code, then check
whether it actually found the flaw.
Grading uses concept groups: the answer has to contain at least one synonym from every required group.
Four numbers come out:
found, did it identify the real vulnerability (this is… See the full description on the dataset page: https://huggingface.co/datasets/MK4-Research/VAB-vulnerability-analysis-benchmark.QML-Based-Network-vulnerability-Analysis-of-IIoT