CoolFace
Modelpublic

rafmacalaba/gliner-datause-displacement

sourceHugging Faceapache-2.0updated 18d agoView on Hugging Face
0likes132downloads
Model Card

gliner-datause-displacement

Fine-tune of urchade/gliner_large-v2.1 for data-use mention extraction with a single `DATA_MENTION` class, trained on `rafmacalaba/data-use-mentions-tiered` — the tiered copy of rafmacalaba/data-use-mentions where Luna/classifier-judged T3 (non-mention) and junk spans are untagged hard negatives (text stays, span removed). The extractor owns the mention boundary only (T1 evidential ∪ T2 declaration vs T3/junk); specificity detail is recovered downstream by the multitask SFT model.

Labels

  • DATA_MENTION — a real data mention that carries an analytic or declarative use (T1 evidential ∪ T2 declaration)

Training

  • base model: urchade/gliner_large-v2.1
  • dataset: rafmacalaba/datause-displacement-reviewed (gliner_reviewed config)
  • epochs: 8
  • learning rate: 5e-06
  • batch size: 16
  • precision: bf16
  • checkpoint selection: val span-F0.5 (post-hoc sweep of epoch checkpoints; eval_loss was explicitly not used)

Evaluation (tiered holdout)

Gold = T1∪T2 spans; a true-FP cluster matching a dropped T3/junk span counts as a T3 leak (lower is better). Label-agnostic Hungarian matching, jaccard >= 0.5 — identical to prior data-use-mentions evals.

thrtpfpfnprecisionrecallf0.5f1t3_leakt3_leak%
0.1012322118350.36780.97240.42000.533743920.7%
0.2012051607620.42850.95110.48140.590837123.1%
0.3011751284920.47780.92740.52910.630732825.6%
0.40114010311270.52510.89980.57280.663228327.5%
0.5010697721980.58070.84370.61930.687924231.4%
0.609635313040.64460.76010.66480.697618434.6%
0.707792864880.73150.61480.70470.668111038.5%

Best F0.5: 0.7047 (thr=0.7) Best F1: 0.6976 (thr=0.6)

Full per-doc predictions (raw scores, gold spans with tier decisions): holdout_predictions.jsonl on this repo.

Corpus breakdown (holdout, best F0.5)

corpusexamplesspansthrprecisionrecallf0.5f1
prwp000.101.00001.00001.00001.0000
fcv000.101.00001.00001.00001.0000