ctf
Datasets
All datasets matching “ctf”alibaba-ctf
Alibaba CTF Benchmark
Alibaba CTF Benchmark is a CTF benchmark designed to measure the frontier of agent work on Capture The Flag security challenges. It consists of 87 high-quality tasks curated from the 2023–2026 AlibabaCTF (formerly AliyunCTF) competition series, covering five core categories: Web (25), Pwn (19), Misc (14), Reverse (16), and Crypto (13). During the curation process, LLM-based challenges were excluded due to their additional credential requirements and test… See the full description on the dataset page: https://huggingface.co/datasets/Alibaba-AAIG/alibaba-ctf.ctfhoard-corpustrain_ctf_eeftrain_ctftest_ctfctf-satml24
Dataset and Lessons Learned from the 2024 SaTML LLM Capture-the-Flag Competition
Welcome to the dataset of the LLM CTF @ SaTML 2024. You can find a detailed report of the competition here.
The task of the attacker was to discover a secret from the start of the chat, hidden by the defending team's system prompt, Python filters, and LLM filters.
The models used were gpt-3.5-turbo-1106 and llama-2-70b-chat.
The dataset contains three splits:
teams: mapping between team names and the… See the full description on the dataset page: https://huggingface.co/datasets/ethz-spylab/ctf-satml24.