caiotheodoro/suture-evals

Suture evals Published predictions on the seed-777 gold in caiotheodoro/suture (benchmark). Score locally with no GPU: cd forge && PYTHONPATH=src uv run python -m suture_forge.cli class-report \ --gold benchmark.jsonl --pred sft-dedhi.jsonl Config System 777 recall HIGH Prec Parse sft-dedhi published adapter 0.959 0.969 0.956 1.0 sft-limithi prior published 0.839 0.893 0.870 1.0 sft-ded unpublished DED mix 0.886 0.913 0.941 1.0 luna GPT-5.6 Luna zero-shot… See the full description on the dataset page: https://huggingface.co/datasets/caiotheodoro/suture-evals.