CoolFace
Datasetpublic

edomg/parse-syslog-auth-failures

parse-syslog-auth-failures Task Overview This is a Terminal-Bench (TB3) task designed to evaluate an AI agent's ability to analyze Linux log files and extract security data. Task Details Environment: Ubuntu 22.04 Input File: /var/log/auth.log Goal: Parse the system authentication log, extract all unique IP addresses associated with failed SSH login attempts (Failed password), and output them to /home/user/failed_ips.txt. Verification: Tested via… See the full description on the dataset page: https://huggingface.co/datasets/edomg/parse-syslog-auth-failures.

sourceHugging Facemitupdated 2mo agoView on Hugging Face
1likes15downloads
Dataset Card

parse-syslog-auth-failures

Task Overview

This is a Terminal-Bench (TB3) task designed to evaluate an AI agent's ability to analyze Linux log files and extract security data.

Task Details

  • Environment: Ubuntu 22.04
  • Input File: /var/log/auth.log
  • Goal: Parse the system authentication log, extract all unique IP addresses associated with failed SSH login attempts (Failed password), and output them to /home/user/failed_ips.txt.
  • Verification: Tested via automated pytest assertions (test_outputs.py).