CoolFace
Apppublic

harborframework/terminal-bench-importer

sourceHugging Faceupdated 6mo agoView on Hugging Face
1likes
App README

This Space automatically processes submissions to the Terminal-Bench 2.0 Leaderboard.

How it works

  1. 1.On Pull Request: Validates the submission and posts a comment with results (pass/fail)
  2. 2.On Merge: Imports validated submissions to the leaderboard database

Required Secrets

Configure these in Space Settings > Repository secrets:

  • —SUPABASE_URL - Supabase project URL
  • —SUPABASE_SECRET_KEY - Supabase service role key
  • —HF_TOKEN - HuggingFace token with write access (for posting comments)
  • —WEBHOOK_SECRET - Secret for webhook verification

Webhook Configuration

Configure at HuggingFace Webhooks Settings:

  • —Target: alexgshaw/terminal-bench-2-leaderboard
  • —URL: https://alexgshaw-terminal-bench-importer.hf.space/webhooks/handle_submission
  • —Events: repo.content, discussion