CoolFace
Apppublic

abhinavy1/AnonyMed_Medical_Data_Anonymization_System

sourceHugging Faceupdated 1y agoView on Hugging Face
0likes
App README

AnonyMed-Medical-Data-Anonymization-System

AnonyMed is a comprehensive tool for anonymizing, managing, and analyzing medical data while preserving patient privacy. This system implements various privacy-preserving techniques including k-anonymity and pseudonymization to help healthcare organizations handle sensitive patient information securely.


๐Ÿ“Œ Overview

The medical field requires special attention to privacy due to the sensitive nature of health data. AnonyMed provides tools to:

  • โ€”Anonymize individual patient records
  • โ€”Process uploaded CSV files containing patient information
  • โ€”Perform privacy analysis and risk scoring
  • โ€”Visualize anonymized data patterns
  • โ€”Conduct cohort analysis on anonymized datasets
  • โ€”Export privacy-preserving datasets for research

๐Ÿ”‘ Core Features

๐Ÿ›ก๏ธ Data Anonymization

  • โ€”Consistent pseudonymization of patient identifiers
  • โ€”Age bracketing to prevent exact age identification
  • โ€”Location generalization for addresses
  • โ€”Medical condition categorization
  • โ€”Automated PHI (Protected Health Information) detection in free text
  • โ€”Secure encryption of original data with access controls

๐Ÿ” Privacy Analysis

  • โ€”K-anonymity verification and reporting
  • โ€”Re-identification risk scoring
  • โ€”Privacy dashboard with visualizations
  • โ€”Data utility preservation metrics

๐Ÿ“Š Data Visualization & Analysis

  • โ€”Distribution visualizations for demographic data
  • โ€”Cohort analysis capabilities
  • โ€”Patient clustering with t-SNE visualization
  • โ€”Privacy risk distribution charts

๐Ÿ› ๏ธ Implementation Notes

๐Ÿ“ฆ Dependencies

The system requires several Python libraries:

  • โ€”pandas, numpy โ€” Data manipulation
  • โ€”matplotlib, seaborn โ€” Visualization
  • โ€”scikit-learn โ€” Clustering and dimensionality reduction
  • โ€”gradio โ€” User interface
  • โ€”cryptography โ€” Secure data storage
  • โ€”spaCy (optional) โ€” PHI detection using NLP

๐Ÿ’พ Data Storage

  • โ€”Anonymized data is stored in CSV format
  • โ€”Original identifiers are encrypted and stored separately
  • โ€”Encryption keys are securely managed

๐Ÿงฉ Privacy Mechanisms

  1. 1.Pseudonymization: Replaces identifiers with consistent pseudonyms
  2. 2.Generalization: Reduces precision of values (e.g., age ranges, location regions)
  3. 3.Categorization: Groups medical conditions into broader categories
  4. 4.K-anonymity: Ensures each record shares attributes with at least k-1 other records
  5. 5.Access Control: Encryption and purpose logging for authorized data recovery

โš ๏ธ Limitations

  1. 1.Basic NLP capabilities โ€” spaCy may miss uncommon/contextual PHI
  2. 2.Limited differential privacy โ€” Formal DP techniques not implemented
  3. 3.Simplistic risk scoring โ€” Only k-anonymity based
  4. 4.Limited attribute inference protection
  5. 5.Simplified cohort analysis โ€” Not a full statistical framework

๐Ÿ” Security Considerations

  • โ€”Additional security measures should be implemented in production
  • โ€”Authorized Access should include proper authentication & authorization
  • โ€”Key management should use secure, dedicated services
  • โ€”Logging and audit trails should be comprehensive
  • โ€”Regular security audits are strongly recommended