Datasetpublic

AITeamUIT/eval-gliner2-ner-mit_restaurant-lossablation

mit_restaurant — loss ablation (5 config x 3 seed) base model: fastino/gliner2-multi-v1 dataset: quynong/mit_restaurant (8 nhan), eval tren split test train: 6 epochs, batch 16, early-stopping patience 2, seeds [42, 43, 44] eval: --threshold 0.7 --use-desc --schema-case original --no-extra-val (giong nhau cho ca 5 config) Ket qua (micro F1 %, mean +/- std tren seed) mode config n seeds micro F1 macro F1 micro P micro R lenient bce 3 88.69 +/- 0.20… See the full description on the dataset page: https://huggingface.co/datasets/AITeamUIT/eval-gliner2-ner-mit_restaurant-lossablation.

sourceHugging Faceupdated 1mo agoView on Hugging Face

0likes10downloads

Dataset Card

mit_restaurant — loss ablation (5 config x 3 seed)

—base model: fastino/gliner2-multi-v1
—dataset: quynong/mit_restaurant (8 nhan), eval tren split test
—train: 6 epochs, batch 16, early-stopping patience 2, seeds [42, 43, 44]
—eval: --threshold 0.7 --use-desc --schema-case original --no-extra-val (giong nhau cho ca 5 config)

Ket qua (micro F1 %, mean +/- std tren seed)

mode	config	n seeds	micro F1	macro F1	micro P	micro R
lenient	bce	3	88.69 +/- 0.20	87.90 +/- 0.17	91.35	86.17
lenient	focal	3	69.08 +/- 7.37	64.26 +/- 9.70	97.02	54.03
lenient	eiou	3	89.31 +/- 0.13	88.48 +/- 0.04	89.02	89.6
lenient	focal_eiou	3	87.50 +/- 1.13	86.65 +/- 1.46	92.23	83.25
lenient	margin	3	88.46 +/- 0.59	87.42 +/- 1.01	91.39	85.72
strict	bce	3	82.73 +/- 0.26	81.90 +/- 0.10	85.22	80.39
strict	focal	3	66.97 +/- 7.17	62.27 +/- 9.33	94.06	52.37
strict	eiou	3	82.73 +/- 0.03	81.99 +/- 0.16	82.46	83.0
strict	focal_eiou	3	81.96 +/- 1.09	80.98 +/- 1.39	86.39	77.99
strict	margin	3	82.33 +/- 0.42	81.22 +/- 0.78	85.07	79.78

Checkpoint tung run

—bce-seed42 -> AITeamUIT/gliner2-ner-mit_restaurant-bce-seed42 (lenient micro F1 88.88)
—bce-seed43 -> AITeamUIT/gliner2-ner-mit_restaurant-bce-seed43 (lenient micro F1 88.49)
—bce-seed44 -> AITeamUIT/gliner2-ner-mit_restaurant-bce-seed44 (lenient micro F1 88.69)
—focal-seed42 -> AITeamUIT/gliner2-ner-mit_restaurant-focal-seed42 (lenient micro F1 76.86)
—focal-seed43 -> AITeamUIT/gliner2-ner-mit_restaurant-focal-seed43 (lenient micro F1 68.18)
—focal-seed44 -> AITeamUIT/gliner2-ner-mit_restaurant-focal-seed44 (lenient micro F1 62.20)
—eiou-seed42 -> AITeamUIT/gliner2-ner-mit_restaurant-eiou-seed42 (lenient micro F1 89.40)
—eiou-seed43 -> AITeamUIT/gliner2-ner-mit_restaurant-eiou-seed43 (lenient micro F1 89.37)
—eiou-seed44 -> AITeamUIT/gliner2-ner-mit_restaurant-eiou-seed44 (lenient micro F1 89.16)
—focal_eiou-seed42 -> AITeamUIT/gliner2-ner-mit_restaurant-focal_eiou-seed42 (lenient micro F1 88.51)
—focal_eiou-seed43 -> AITeamUIT/gliner2-ner-mit_restaurant-focal_eiou-seed43 (lenient micro F1 87.70)
—focal_eiou-seed44 -> AITeamUIT/gliner2-ner-mit_restaurant-focal_eiou-seed44 (lenient micro F1 86.28)
—margin-seed42 -> AITeamUIT/gliner2-ner-mit_restaurant-margin-seed42 (lenient micro F1 89.03)
—margin-seed43 -> AITeamUIT/gliner2-ner-mit_restaurant-margin-seed43 (lenient micro F1 88.48)
—margin-seed44 -> AITeamUIT/gliner2-ner-mit_restaurant-margin-seed44 (lenient micro F1 87.86)

generated 2026-08-20T07:43:19