AITeamUIT/eval-gliner2-ner-classweight-3seed
Class-weighted loss — 3 seed x 4 dataset train: --loss-class-weight tren fastino/gliner2-multi-v1, batch 16, patience 2, seeds [42, 43, 44] eval : --threshold 0.7 --use-desc --schema-case original --no-extra-val (giong loss ablation) dataset epochs eval split strict macro F1 lenient micro F1 conll2003 6 test 86.06 +/- 0.95 89.31 +/- 0.95 ontonotes5 3 test 77.47 +/- 0.51 90.30 +/- 0.06 fin 8 test 38.15 +/- 2.40 75.92 +/- 1.36 mit_restaurant 6 test 81.55 +/-… See the full description on the dataset page: https://huggingface.co/datasets/AITeamUIT/eval-gliner2-ner-classweight-3seed.
08
Class-weighted loss — 3 seed x 4 dataset
- train:
--loss-class-weighttrenfastino/gliner2-multi-v1, batch 16, patience 2, seeds [42, 43, 44] - eval :
--threshold 0.7 --use-desc --schema-case original --no-extra-val(giong loss ablation)
Dong cho tab:macro-f1 (strict macro F1)
Class-weighted & $ 86.06_{\pm 0.95} $ & $ 77.47_{\pm 0.51} $ & $ 38.15_{\pm 2.40} $ & $ 81.55_{\pm 0.26} $ & 70.81 \\Checkpoint tung run
fin-cw-seed42-> AITeamUIT/gliner2-ner-fin-cw-seed42 (strict macro F1 38.21)fin-cw-seed43-> AITeamUIT/gliner2-ner-fin-cw-seed43 (strict macro F1 35.72)fin-cw-seed44-> AITeamUIT/gliner2-ner-fin-cw-seed44 (strict macro F1 40.51)mit_restaurant-cw-seed42-> AITeamUIT/gliner2-ner-mit_restaurant-cw-seed42 (strict macro F1 81.45)mit_restaurant-cw-seed43-> AITeamUIT/gliner2-ner-mit_restaurant-cw-seed43 (strict macro F1 81.35)mit_restaurant-cw-seed44-> AITeamUIT/gliner2-ner-mit_restaurant-cw-seed44 (strict macro F1 81.84)conll2003-cw-seed42-> AITeamUIT/gliner2-ner-conll2003-cw-seed42 (strict macro F1 85.09)conll2003-cw-seed43-> AITeamUIT/gliner2-ner-conll2003-cw-seed43 (strict macro F1 86.12)conll2003-cw-seed44-> AITeamUIT/gliner2-ner-conll2003-cw-seed44 (strict macro F1 86.98)ontonotes5-cw-seed42-> AITeamUIT/gliner2-ner-ontonotes5-cw-seed42 (strict macro F1 77.61)ontonotes5-cw-seed43-> AITeamUIT/gliner2-ner-ontonotes5-cw-seed43 (strict macro F1 77.89)ontonotes5-cw-seed44-> AITeamUIT/gliner2-ner-ontonotes5-cw-seed44 (strict macro F1 76.90)
generated 2026-08-22T14:20:16