CoolFace
Datasetpublic

TechWolf/Skill-extraction-TechWolf-graded

skill-extraction-techwolf-graded Graded-relevance annotations for sentences from TechWolf/skill-extraction-techwolf against the ESCO v1.1.0 skill taxonomy. Layout follows the BEIR convention so it is drop-in for MTEB-style retrieval evaluators. This dataset was created for the RecSys-HR 2026 WorkRB challenge. Configs config split rows columns queries test 324 _id (sentence id), text (sentence) corpus corpus 13,891 _id (ESCO skill URI), title (English… See the full description on the dataset page: https://huggingface.co/datasets/TechWolf/Skill-extraction-TechWolf-graded.

sourceHugging Facecc-by-4.0updated 21d agoView on Hugging Face
0likes120downloads
Dataset Card

skill-extraction-techwolf-graded

Graded-relevance annotations for sentences from `TechWolf/skill-extraction-techwolf` against the ESCO v1.1.0 skill taxonomy. Layout follows the BEIR convention so it is drop-in for MTEB-style retrieval evaluators.

This dataset was created for the RecSys-HR 2026 WorkRB challenge.

Configs

configsplitrowscolumns
queriestest324_id (sentence id), text (sentence)
corpuscorpus13,891_id (ESCO skill URI), title (English preferred label), text (English description), esco_version
qrelstest4,500,684query-id, corpus-id, score (0-4)

Higher is more relevant. The corpus is the COMPLETE ESCO v1.1.0 skill list (13,891 skills) The qrels are the full query x corpus grid: every query is scored against all 13,891 skills, with score 0 for any skill that was not surfaced as relevant.

Score scale, validation split

scorevolumemeaning
01,000,838The skill is totally unrelated to the sentence.
140,060The skill's domain is correct. It's a plausible skill in a broader context, but not mentioned in this sentence.
2598The skill could be recommended, but its granularity makes it not core to the query.
3154The skill is strongly relevant for this query, although it is more implied than explicitly demonstrated.
4175The skill is explicitly demonstrated or requested by the query, and is therefore a clearly correct recommendation.

Score scale, test split

scorevolumemeaning
04,280,810The skill is totally unrelated to the sentence.
1214,208The skill's domain is correct. It's a plausible skill in a broader context, but not mentioned in this sentence.
23,197The skill could be recommended, but its granularity makes it not core to the query.
31,720The skill is strongly relevant for this query, although it is more implied than explicitly demonstrated.
4749The skill is explicitly demonstrated or requested by the query, and is therefore a clearly correct recommendation.

Usage

python
from datasets import load_dataset

queries = load_dataset("TechWolf/Skill-extraction-TechWolf-graded", "queries", split="test")
corpus  = load_dataset("TechWolf/Skill-extraction-TechWolf-graded", "corpus",  split="corpus")
qrels   = load_dataset("TechWolf/Skill-extraction-TechWolf-graded", "qrels",   split="test")

Join on ids: qrels["query-id"] matches queries["_id"], and qrels["corpus-id"] matches corpus["_id"] (a full ESCO skill URI).

Attribution

This dataset uses the ESCO classification of the European Commission (ESCO v1.1.0, <https://esco.ec.europa.eu>), licensed under CC BY 4.0. The ESCO content has been extracted into a tabular subset (skill URI, English preferred label, English description); no semantic modifications were made. The European Commission is not responsible for any use of the data.

Source sentences come from `TechWolf/skill-extraction-techwolf` (also CC BY 4.0). The judge labels themselves are released under CC BY 4.0.

Citation

To be announced