Firmansyah-Ibrahim/idt5-v4-results-final-lora-s2026-20260912T034640190015Z
final-lora-s2026-20260912T034640190015Z Run artifacts and per-item predictions. Phase: final. These are newly generated results, not a reproduction of the legacy TCI tables. See run_manifest.json, rules.json, generation_protocol.json and checkpoint_hashes.json. Structural scores do not establish semantic or Bloom validity. Metrics { "n": 267, "rule_version": "structural-proxy-v0.4-grounding-separated", "parse_success_pct": 95.88014981273409, "bleu":… See the full description on the dataset page: https://huggingface.co/datasets/Firmansyah-Ibrahim/idt5-v4-results-final-lora-s2026-20260912T034640190015Z.
final-lora-s2026-20260912T034640190015Z
Run artifacts and per-item predictions.
Phase: final. These are newly generated results, not a reproduction of the legacy TCI tables.
See runmanifest.json, rules.json, generationprotocol.json and checkpoint_hashes.json. Structural scores do not establish semantic or Bloom validity.
Metrics
{
"n": 267,
"rule_version": "structural-proxy-v0.4-grounding-separated",
"parse_success_pct": 95.88014981273409,
"bleu": 7.5063516803346095,
"bleu_signature": "nrefs:1|case:mixed|eff:no|tok:13a|smooth:exp|version:2.5.1",
"rouge1": 20.60644090399861,
"rouge2": 8.54371950794391,
"rougeL": 19.81505888524,
"C1_question_bleu": 11.411045501629344,
"C1_question_rougeL": 25.651461938184166,
"C1_n": 143,
"C1_passed": 82,
"C1_pct": 57.34265734265734,
"C2_question_bleu": 3.761297048977834,
"C2_question_rougeL": 13.084368267731797,
"C2_n": 124,
"C2_passed": 2,
"C2_pct": 1.6129032258064515,
"answer_rougeL": 14.881916192221906,
"macro_structural_pct": 29.477780284231894,
"answer_grounded_n": 54,
"answer_grounded_pct": 37.76223776223776,
"answer_grounded_scope": "item C1 saja; C2 memang tidak ekstraktif menurut rancangan",
"run_id": "final-lora-s2026-20260912T034640190015Z",
"phase": "final",
"eval_split": "test",
"method": "lora",
"seed": 2026,
"precision_resolved": "fp32",
"input_truncated_n": 0
}Data reuse terms and source attribution must be reviewed before making this repository public.