Firmansyah-Ibrahim/idt5-v4-results-final-fft-s123-20260910T215641650583Z
final-fft-s123-20260910T215641650583Z Run artifacts and per-item predictions. Phase: final. These are newly generated results, not a reproduction of the legacy TCI tables. See run_manifest.json, rules.json, generation_protocol.json and checkpoint_hashes.json. Structural scores do not establish semantic or Bloom validity. Metrics { "n": 267, "rule_version": "structural-proxy-v0.4-grounding-separated", "parse_success_pct": 93.25842696629213, "bleu":… See the full description on the dataset page: https://huggingface.co/datasets/Firmansyah-Ibrahim/idt5-v4-results-final-fft-s123-20260910T215641650583Z.
final-fft-s123-20260910T215641650583Z
Run artifacts and per-item predictions.
Phase: final. These are newly generated results, not a reproduction of the legacy TCI tables.
See runmanifest.json, rules.json, generationprotocol.json and checkpoint_hashes.json. Structural scores do not establish semantic or Bloom validity.
Metrics
{
"n": 267,
"rule_version": "structural-proxy-v0.4-grounding-separated",
"parse_success_pct": 93.25842696629213,
"bleu": 8.815472256347494,
"bleu_signature": "nrefs:1|case:mixed|eff:no|tok:13a|smooth:exp|version:2.5.1",
"rouge1": 27.257044362857897,
"rouge2": 10.88920847869384,
"rougeL": 25.752995356750734,
"C1_question_bleu": 11.166287279885369,
"C1_question_rougeL": 29.589505308905085,
"C1_n": 143,
"C1_passed": 131,
"C1_pct": 91.60839160839161,
"C2_question_bleu": 6.754262705836051,
"C2_question_rougeL": 21.328633073217905,
"C2_n": 124,
"C2_passed": 106,
"C2_pct": 85.48387096774194,
"answer_rougeL": 21.26624494301145,
"macro_structural_pct": 88.54613128806677,
"answer_grounded_n": 103,
"answer_grounded_pct": 72.02797202797203,
"answer_grounded_scope": "item C1 saja; C2 memang tidak ekstraktif menurut rancangan",
"run_id": "final-fft-s123-20260910T215641650583Z",
"phase": "final",
"eval_split": "test",
"method": "fft",
"seed": 123,
"precision_resolved": "fp32",
"input_truncated_n": 0
}Data reuse terms and source attribution must be reviewed before making this repository public.