Datasetpublic

sm1rk/diagnosis-matching-project-data

Diagnosis Matching Dataset Dataset for matching pairs of free-text Russian medical diagnoses. Part of the kilimanj4r0/diagnosis-matching-project. Files File Size Description final-test.csv 55 MB Raw diagnosis pairs (272K rows) final-test-preprocessed.csv 77 MB Cleaned diagnosis pairs rag-diagnosis2icd.json 2.2 MB Diagnosis → ICD-10 mapping (~16K entries) rag-bergamot-index.faiss 51 MB FAISS embedding index for RAG rag-bergamot-index.pkl 3.5 MB… See the full description on the dataset page: https://huggingface.co/datasets/sm1rk/diagnosis-matching-project-data.

sourceHugging Facecc-by-4.0updated 4mo agoView on Hugging Face

0likes112downloads

Dataset Card

Diagnosis Matching Dataset

Dataset for matching pairs of free-text Russian medical diagnoses. Part of the kilimanj4r0/diagnosis-matching-project.

Files

File	Size	Description
`final-test.csv`	55 MB	Raw diagnosis pairs (272K rows)
`final-test-preprocessed.csv`	77 MB	Cleaned diagnosis pairs
`rag-diagnosis2icd.json`	2.2 MB	Diagnosis → ICD-10 mapping (~16K entries)
`rag-bergamot-index.faiss`	51 MB	FAISS embedding index for RAG
`rag-bergamot-index.pkl`	3.5 MB	FAISS index metadata
`distil-gold.csv`	538 KB	Expert-labeled pairs (4.8K rows)
`distil-silver.csv`	33 MB	Teacher-pseudo-labeled pairs (272K rows)
`distil-test.csv`	305 KB	Test set with features (1.5K rows)
`distil-train-full.csv`	33 MB	Gold + silver combined (277K rows)
`distil-train-isgold-full.csv`	33 MB	Full train + is_gold flag
`distil-train-nondup.csv`	7.8 MB	Deduplicated train (57K rows)
`distil-train-isgold-nondup.csv`	7.7 MB	Deduped train + is_gold
`distil-train-isgold-preprocessed-nondup.csv`	7.5 MB	Final training data
`ablation-train.csv`	567 KB	Feature-engineered train (4.8K rows)
`ablation-test.csv`	171 KB	Feature-engineered test (1.5K rows)

Usage

python

from huggingface_hub import snapshot_download

path = snapshot_download("sm1rk/diagnosis-matching-project-data", repo_type="dataset")
# Access files: path + "/final-test.csv", etc.