AITeamUIT/eval-gliner2-ner-setconsistent
Set-consistent — 4 bo NER, 18 run base model: fastino/gliner2-multi-v1 train: --loss set (mac dinh cua train.py cho moi tham so set) eval: --threshold 0.5 --use-desc --schema-case original --no-extra-val --loss set tu bat learnable null anchor trong scorer, nen checkpoint decode o threshold 0.5 — khac 0.7 cua bang loss-ablation 5 config. Khac biet co chu dich, khong phai threshold tuning. Ngan sach tung bo bo repo nhan split seeds epochs batch fin… See the full description on the dataset page: https://huggingface.co/datasets/AITeamUIT/eval-gliner2-ner-setconsistent.
027
Set-consistent — 4 bo NER, 18 run
- base model:
fastino/gliner2-multi-v1 - train:
--loss set(mac dinh cua train.py cho moi tham so set) - eval:
--threshold 0.5 --use-desc --schema-case original --no-extra-val
--loss set tu bat learnable null anchor trong scorer, nen checkpoint decode o threshold 0.5 — khac 0.7 cua bang loss-ablation 5 config. Khac biet co chu dich, khong phai threshold tuning.Ngan sach tung bo
Ket qua (%, mean +/- std tren seed)
Dong cho tab:macro-f1 (strict macro F1)
\textbf{Set-consistent (ours)} & $ 86.91_{\pm 0.74} $ & $ 76.96_{\pm 0.40} $ & $ 40.56_{\pm 5.90} $ & $ 81.46_{\pm 0.44} $ & \textbf{71.47} \\Checkpoint tung run
fin-set-seed42-> AITeamUIT/gliner2-ner-fin-set-seed42 (strict macro F1 47.61)fin-set-seed43-> AITeamUIT/gliner2-ner-fin-set-seed43 (strict macro F1 45.63)fin-set-seed44-> AITeamUIT/gliner2-ner-fin-set-seed44 (strict macro F1 39.22)fin-set-seed45-> AITeamUIT/gliner2-ner-fin-set-seed45 (strict macro F1 36.50)fin-set-seed46-> AITeamUIT/gliner2-ner-fin-set-seed46 (strict macro F1 33.82)mit_restaurant-set-seed42-> AITeamUIT/gliner2-ner-mit_restaurant-set-seed42 (strict macro F1 81.44)mit_restaurant-set-seed43-> AITeamUIT/gliner2-ner-mit_restaurant-set-seed43 (strict macro F1 81.92)mit_restaurant-set-seed44-> AITeamUIT/gliner2-ner-mit_restaurant-set-seed44 (strict macro F1 80.74)mit_restaurant-set-seed45-> AITeamUIT/gliner2-ner-mit_restaurant-set-seed45 (strict macro F1 81.52)mit_restaurant-set-seed46-> AITeamUIT/gliner2-ner-mit_restaurant-set-seed46 (strict macro F1 81.70)conll2003-set-seed42-> AITeamUIT/gliner2-ner-conll2003-set-seed42 (strict macro F1 87.29)conll2003-set-seed43-> AITeamUIT/gliner2-ner-conll2003-set-seed43 (strict macro F1 85.94)conll2003-set-seed44-> AITeamUIT/gliner2-ner-conll2003-set-seed44 (strict macro F1 86.78)conll2003-set-seed45-> AITeamUIT/gliner2-ner-conll2003-set-seed45 (strict macro F1 86.62)conll2003-set-seed46-> AITeamUIT/gliner2-ner-conll2003-set-seed46 (strict macro F1 87.90)ontonotes5-set-seed42-> AITeamUIT/gliner2-ner-ontonotes5-set-seed42 (strict macro F1 77.06)ontonotes5-set-seed43-> AITeamUIT/gliner2-ner-ontonotes5-set-seed43 (strict macro F1 77.31)ontonotes5-set-seed44-> AITeamUIT/gliner2-ner-ontonotes5-set-seed44 (strict macro F1 76.52)
generated 2026-08-22T09:38:00