Firmansyah-Ibrahim/idt5-v4-results-final-fft-s42-20260910T135823740810Z
final-fft-s42-20260910T135823740810Z Run artifacts and per-item predictions. Phase: final. These are newly generated results, not a reproduction of the legacy TCI tables. See run_manifest.json, rules.json, generation_protocol.json and checkpoint_hashes.json. Structural scores do not establish semantic or Bloom validity. Metrics { "n": 267, "rule_version": "structural-proxy-v0.4-grounding-separated", "parse_success_pct": 93.63295880149813, "bleu":… See the full description on the dataset page: https://huggingface.co/datasets/Firmansyah-Ibrahim/idt5-v4-results-final-fft-s42-20260910T135823740810Z.
final-fft-s42-20260910T135823740810Z
Run artifacts and per-item predictions.
Phase: final. These are newly generated results, not a reproduction of the legacy TCI tables.
See runmanifest.json, rules.json, generationprotocol.json and checkpoint_hashes.json. Structural scores do not establish semantic or Bloom validity.
Metrics
{
"n": 267,
"rule_version": "structural-proxy-v0.4-grounding-separated",
"parse_success_pct": 93.63295880149813,
"bleu": 7.806484074983715,
"bleu_signature": "nrefs:1|case:mixed|eff:no|tok:13a|smooth:exp|version:2.5.1",
"rouge1": 27.129099655608645,
"rouge2": 10.050650705873682,
"rougeL": 25.545565044955865,
"C1_question_bleu": 10.648604415773155,
"C1_question_rougeL": 29.686972061439338,
"C1_n": 143,
"C1_passed": 129,
"C1_pct": 90.20979020979021,
"C2_question_bleu": 5.121513107925827,
"C2_question_rougeL": 20.769587598527337,
"C2_n": 124,
"C2_passed": 107,
"C2_pct": 86.29032258064517,
"answer_rougeL": 18.634454658735496,
"macro_structural_pct": 88.25005639521768,
"answer_grounded_n": 107,
"answer_grounded_pct": 74.82517482517483,
"answer_grounded_scope": "item C1 saja; C2 memang tidak ekstraktif menurut rancangan",
"run_id": "final-fft-s42-20260910T135823740810Z",
"phase": "final",
"eval_split": "test",
"method": "fft",
"seed": 42,
"precision_resolved": "fp32",
"input_truncated_n": 0
}Data reuse terms and source attribution must be reviewed before making this repository public.