Programmer-RD-AI/sfia-9-scraped

SFIA-9-Scraped Dataset

This repository contains the SFIA-9-Scraped dataset, a JSON collection of the Skills Framework for the Information Age (SFIA) version 9 categories and levels, scraped for non-commercial research use.

🚀 Dataset Overview

• —Name: SFIA-9-Scraped
• —Hugging Face: Programmer-RD-AI/sfia-9-scraped
• —DOI: 10.57967/hf/5746
• —Author: Ranuga Disansa Gamage
• —Revision: 89feeb8
• —Publisher: Hugging Face
• —Year: 2025

Use this dataset to build RAG systems, taxonomy-driven search, skill-gap analytics, and other AI/ML applications focused on professional skill frameworks.

📂 Data Structure

The dataset is provided as a single JSON file (sfia_9_data.json) with the following top-level structure:

{
  "url": [ "...", "...", ... ],
  "raw_content": [ "...", "...", ... ],
  "images": [ "...", "...", ... ]
}

• —url: array[string] — list of page URLs for each scraped entry.
• —raw\_content: array[string] — the extracted textual content from each URL.
• —images: array[string] — list of image URLs associated with each entry.

⚙️ Usage

Install the 🤗 Datasets library:

pip install datasets

Load the dataset:

from datasets import load_dataset

ds = load_dataset("Programmer-RD-AI/sfia-9-scraped")
print(ds["train"][0])

For RAG applications, integrate this dataset as your taxonomy source before chunking and embedding.

📜 Citation

If you use this dataset in your research, please cite:

@misc{ranuga_disansa_gamage_2025,
  author    = {Ranuga Disansa Gamage},
  title     = {sfia-9-scraped (Revision 89feeb8)},
  year      = {2025},
  url       = {https://huggingface.co/datasets/Programmer-RD-AI/sfia-9-scraped},
  doi       = {10.57967/hf/5746},
  publisher = {Hugging Face}
}

📄 License

This dataset is released under the Creative Commons Attribution-NonCommercial 4.0 International (CC BY-NC 4.0) license. Use for non-commercial research only.

View license details

🤝 Acknowledgements

• —SFIA Foundation: Original SFIA-9 framework content.

✉️ Contact

For questions or contributions, open an issue or pull request on the Hugging Face dataset page.