rafmacalaba/datause-extracted
Data-use mentions (NER / span extraction) Data mentions extracted from World Bank Policy Research Working Papers and FCV documents, predicted by a span-extraction model with no human or LLM-judge validation, and formatted for span-extraction (GLiNER / GLiNER2) and token-classification (LFM2.5-encoder) fine-tuning. Labels Three entity types: NAMED_DATA — a proper name, title, or acronym of a specific data source DESCRIPTIVE_DATA — a source described in words but… See the full description on the dataset page: https://huggingface.co/datasets/rafmacalaba/datause-extracted.
0278
1{2 "train": {3 "examples": 201025,4 "positive": 160820,5 "negative_only": 40205,6 "positive_spans": 237599,7 "neg_ratio": 0.25,8 "corpus_counts": {9 "prwp": 116583,10 "fcv": 8444211 },12 "origin_counts": {13 "general_prwp": 116583,14 "fcv_pads_east_africa": 67852,15 "refugee_pads": 3346,16 "reliefweb": 12420,17 "jdc_operational": 717,18 "jad_paddy_docs": 10719 }20 },21 "val": {22 "examples": 42414,23 "positive": 33931,24 "negative_only": 8483,25 "positive_spans": 50598,26 "neg_ratio": 0.25,27 "corpus_counts": {28 "fcv": 18051,29 "prwp": 2436330 },31 "origin_counts": {32 "fcv_pads_east_africa": 14748,33 "general_prwp": 24363,34 "reliefweb": 2761,35 "jdc_operational": 122,36 "refugee_pads": 42037 }38 },39 "holdout": {40 "examples": 44174,41 "positive": 35339,42 "negative_only": 8835,43 "positive_spans": 53340,44 "neg_ratio": 0.25,45 "corpus_counts": {46 "fcv": 17947,47 "prwp": 2622748 },49 "origin_counts": {50 "fcv_pads_east_africa": 14531,51 "general_prwp": 26227,52 "reliefweb": 2195,53 "refugee_pads": 824,54 "jdc_operational": 341,55 "jad_paddy_docs": 5656 }57 }58}