Datasetpublic

SafeVixAI/SafeVixAI-Dataset-Hub

SafeVixAI Dataset Hub 🛡️ The Intelligence Layer for the SafeVixAI platform — IIT Madras Road Safety Hackathon 2026 This repository hosts all datasets, pre-trained models, notebooks, and reproducible data acquisition scripts that power the SafeVixAI application. It is designed to be cloned directly into Google Colab or any research environment. Main Application Repo: SafeVixAI/SafeVixAI ⚡ Quickstart (Google Colab) # Clone the entire intelligence layer !git… See the full description on the dataset page: https://huggingface.co/datasets/SafeVixAI/SafeVixAI-Dataset-Hub.

sourceHugging Faceapache-2.0updated 4mo agoView on Hugging Face

1likes147downloads

rootscriptsREADME.md

README.md84 linesDownload Raw Back to scripts

1# SafeVixAI — Data Acquisition Scripts 🔬2 3These scripts are the **raw data pipeline** that built the 4.2 GB SafeVixAI dataset.4All scripts here are **pure Python** — they require no database, no Redis, no PostGIS.5 6> Scripts are mirrored from the [SafeVixAI main repo](https://github.com/SafeVixAI/SafeVixAI) and organized by their origin folder.7 8---9 10## 📁 Structure11 12```13scripts/14├── backend/                  ← from SafeVixAI/backend/scripts/15│   ├── app/                  ← Web app database setup & SQL migrations16│   └── data/                 ← Civic intel ETL pipelines & seeders17│18├── chatbot_service/          ← from SafeVixAI/chatbot_service/scripts/19│   ├── app/                  ← Chatbot seeders20│   ├── data/                 ← Overpass GIS fetchers (Pro version)21│   └── verify_rag.py         ← Vectorstore validation22│23└── scripts/                  ← from SafeVixAI/scripts/24    ├── app/                  ← Asset generators25    └── data/                 ← Scrapers, downloaders, and legacy seeders26```27 28---29 30## 🚀 Recommended Run Order31 32```bash33# Install dependencies first34pip install requests pdfplumber35 36# 1. Setup Kaggle API (one-time)37pwsh scripts/scripts/data/setup_kaggle.ps138 39# 2. Fetch all emergency services (use Pro versions)40python scripts/chatbot_service/data/fetch_hospitals.py41python scripts/chatbot_service/data/fetch_police.py42python scripts/chatbot_service/data/fetch_ambulance.py43python scripts/chatbot_service/data/fetch_blood_banks.py44python scripts/chatbot_service/data/fetch_fire.py45 46# 3. Download legal documents47python scripts/scripts/data/download_legal_pdfs.py48 49# 4. Extract MoRTH accident tables from PDFs50python scripts/scripts/data/extract_morth2022_tables.py51 52# 5. Normalize accident blackspot data53python scripts/scripts/data/seed_blackspots.py54 55# 6. Normalize traffic violations (MVA 2019)56python scripts/backend/data/seed_violations.py57 58# 7. Verify everything is correct59python scripts/scripts/data/verify_data.py60```61 62---63 64## ⭐ Pro vs Basic Fetchers65 66| Feature | `scripts/scripts/data/fetch_*.py` | `scripts/chatbot_service/data/fetch_*.py` |67|---|---|---|68| Retry logic | ❌ | ✅ |69| Exponential backoff | ❌ | ✅ |70| Indian GIS precision | Basic | Enhanced |71| Extra fields (email, postcode) | ❌ | ✅ |72 73**Always prefer `chatbot_service/data/` versions** for data acquisition.74 75---76 77## 📦 Dependencies78 79```80pip install -r requirements.txt81```82 83See `requirements.txt` in the Hub root.84