CoolFace
Datasetpublic

alflax77/glints-job-scraping

Glints Job Scraper Dataset Description This dataset provides a collection of job postings from Glints Indonesia, developed for the Analitik Big Data course to scrape job data from sites. Methodology The data acquisition utilized a hybrid scraping approach: API Reverse Engineering: Request headers and GraphQL query structures were reverse-engineered to fetch structured data from unofficial endpoints. Parsing: BeautifulSoup4 was used to extract… See the full description on the dataset page: https://huggingface.co/datasets/alflax77/glints-job-scraping.

sourceHugging Facemitupdated 3mo agoView on Hugging Face
0likes43downloads
Dataset Card

Glints Job Scraper Dataset

Description

This dataset provides a collection of job postings from Glints Indonesia, developed for the Analitik Big Data course to scrape job data from sites.

Methodology

The data acquisition utilized a hybrid scraping approach:

  • —API Reverse Engineering: Request headers and GraphQL query structures were reverse-engineered to fetch structured data from unofficial endpoints.
  • —Parsing: BeautifulSoup4 was used to extract metadata from HTML fields not fully serialized in the API.
  • —Environment: Developed using Python 3.12 within a dedicated virtual environment.

Note: This dataset contains multiple duplicate data as the jobs may fall into multiple job categories.

Dataset Structure

The dataset consists of the following attributes:

Attribute NameDescriptionExample Value
job_titleThe specific title or position of the job.Data Analyst, Backend Engineer
company_nameThe name of the hiring organization.PT Tokopedia, Gojek
locationThe city or work location.Jakarta, Surabaya, Remote
job_typeThe type of employment contract.Full-time, Part-time, Internship
experience_levelThe required level of professional experience.Fresh Graduate, 2-3 tahun
education_reqMinimum educational background required.S1 Informatika, D3 semua jurusan
salary_rangeReported compensation range (if available).Rp 8.000.000 – Rp 12.000.000
job_requirementsList of required technical and soft skills.Python, SQL, komunikasi baik
job_responsibilitiesCore tasks and responsibilities of the role.Menganalisis data penjualan, ...
posted_dateThe date the vacancy was originally posted.2024-11-15
source_platformThe platform from which the data was scraped.Glints
category_scrapedBroad job category or department.IT, Admin HR

Use Cases

  • —Classification: Using job_description or job_requirements to predict kategori.
  • —Salary Analysis: Investigating how experience_level and location impact salary_range.
  • —Named Entity Recognition (NER): Extracting specific skills or tools from requirement texts.

Disclaimer: This project is for educational purposes only. Users should respect the target platform's Terms of Service regarding data usage.