CoolFace
Modelpublic

rafmacalaba/gliner-datause-mentions-catch-all

sourceHugging Faceapache-2.0updated 15d agoView on Hugging Face
0likes20downloads
Model Card

gliner-datause-mentions-catch-all

GLiNER catch-all proposer (catch_all) trained on rafmacalaba/data-use-mentions (config catch_all, column ner):

  • arm catch_all: ner column (every candidate span is DATAMENTION: keeps and drops alike) — recall-oriented proposer for the probe cascade. The probe head owns keep/drop. Eval: gold = DATAMENTION spans; predictions = DATA_MENTION predictions only.

Training

  • base model: urchade/gliner_large-v2.1
  • dataset: rafmacalaba/data-use-mentions (config catch_all, column ner)
  • labels: DATA_MENTION
  • corpus: all
  • epochs: 5
  • learning rate: 5e-06
  • batch size: 16
  • precision: bf16

Evaluation (holdout, DATA_MENTION only)

thrtpfpfnprecisionrecallf0.5f1
0.1021326107403640.66510.98320.71110.7934
0.202116881645220.72170.97590.76130.8298
0.302098767057030.75790.96760.79220.8500
0.402071853699720.79420.95520.82190.8673
0.5020227407214630.83240.93250.85070.8796
0.6019318290123720.86940.89060.87360.8799
0.7017611186940790.90410.81190.88400.8555

Best F0.5: 0.8840 (thr=0.7) Best F1: 0.8799 (thr=0.6)

Breakdown (best-F0.5 operating point)

groupexamplesspansthrprecisionrecallf0.5f1
overall18709220520.700.90410.81190.88400.8555
prwp9188123590.700.89810.76260.86720.8248
fcv952196930.700.91100.87660.90390.8935
fcvpadseast_africa679467840.700.92100.87890.91230.8995
general_prwp9188123590.700.89810.76260.86720.8248
jdc_operational1582040.600.96240.91330.95210.9372
refugee_pads6877430.700.89890.88520.89610.8920
reliefweb188219620.700.87710.86610.87490.8716