achinta3/cybersec-jsonschemabench-cloudtrail-hard-v2-400
CybersecJSONSchemaBench CloudTrail Hard v2 400 This is a 100-problem synthetic long-context cybersecurity reasoning subset built from the full flAWS CloudTrail corpus. The benchmark asks models to return JSON matching the provided answer schema. Each row contains a short analyst request, a large CloudTrail JSONL context, and hidden deterministic evaluation metadata. This variant uses shorter 400-record contexts than the full CloudTrail Hard v2 export so direct API evaluation is… See the full description on the dataset page: https://huggingface.co/datasets/achinta3/cybersec-jsonschemabench-cloudtrail-hard-v2-400.
08
Upload CybersecJSONSchemaBench benchmark export
Upload CybersecJSONSchemaBench benchmark export
initial commit
