Datasetpublic

rafmacalaba/datause-ner

Datause NER (catch-all DATA_MENTION + probe configs) Catch-all NER views over rafmacalaba/datause-probe-v3 passages (29,346 spans grouped into passage examples). Single entity type DATA_MENTION: every candidate span is tagged, keeps and drops alike — the probe head (not NER tags) owns the keep/drop boundary. No NAMED/DESCRIPTIVE/VAGUE subtypes, no NON_MENTION. Per-origin thresholds (head best-F1, published holdout sweep) origin threshold… See the full description on the dataset page: https://huggingface.co/datasets/rafmacalaba/datause-ner.

sourceHugging Faceapache-2.0updated 13d agoView on Hugging Face

0likes179downloads

rootsplit_stats.json

split_stats.json55 linesDownload Raw Back to root

1{2  "train": {3    "examples": 18751,4    "spans": 20282,5    "pred_keep_spans": 12770,6    "pred_drop_spans": 7512,7    "origin_counts": {8      "fcv_pads_east_africa": 5301,9      "jad_paddy_docs": 79,10      "jdc_operational": 647,11      "general_prwp": 7960,12      "refugee_pads": 1606,13      "reliefweb": 315814    },15    "corpus_counts": {16      "fcv": 10791,17      "prwp": 796018    }19  },20  "val": {21    "examples": 4107,22    "spans": 4407,23    "pred_keep_spans": 2754,24    "pred_drop_spans": 1653,25    "origin_counts": {26      "fcv_pads_east_africa": 1134,27      "jdc_operational": 89,28      "general_prwp": 1756,29      "refugee_pads": 404,30      "reliefweb": 72431    },32    "corpus_counts": {33      "fcv": 2351,34      "prwp": 175635    }36  },37  "holdout": {38    "examples": 4203,39    "spans": 4657,40    "pred_keep_spans": 2963,41    "pred_drop_spans": 1694,42    "origin_counts": {43      "fcv_pads_east_africa": 1075,44      "jad_paddy_docs": 77,45      "jdc_operational": 198,46      "general_prwp": 1784,47      "refugee_pads": 375,48      "reliefweb": 69449    },50    "corpus_counts": {51      "fcv": 2419,52      "prwp": 178453    }54  }55}