CoolFace
Apppublic

AI-RESEARCHER-2024/Medical-School-Personal-Statement-Analyzer

sourceHugging Faceupdated 8mo agoView on Hugging Face
0likes
App README

Medical School Personal Statement Analyzer

AI-powered analysis of medical school personal statements using the official Coding Scheme & Rubric.

What It Does

Upload a personal statement (.docx, .txt, or .pdf) and the tool will:

  1. 1.Segment the essay into meaningful content blocks
  2. 2.Classify each segment into one of four rubric categories
  3. 3.Score each segment on a 1-to-4 scale per the rubric
  4. 4.Assess the Thread across the whole essay (1-to-4)

Rubric Categories

CategoryDefinition
SparkOpening story or realization that spurs interest in medicine
Healthcare ExperienceWatching or participating in a healthcare setting
Showing Doctor QualitiesPortraying vision of what a doctor is or does
SpinConnecting experiences to the profession of being a doctor
Thread (whole-essay)One character trait woven through all experiences

Scoring Scale

  • —4 = Excellent (vivid, specific, engaging, logical)
  • —3 = Good (mostly effective, minor gaps)
  • —2 = Fair (bland/boring but not problematic)
  • —1 = Low (disconnected, vague, problematic)

Setup

Secrets Required

Add one of these as a Secret in your Space Settings:

  • —MOONSHOT_API_KEY for Kimi-K2-Instruct (Moonshot)
  • —ANTHROPIC_API_KEY for Claude (Anthropic)

Files

  • —app.py - Streamlit application (main entry point)
  • —llm_analyzer.py - LLM integration and rubric prompt
  • —document_processor.py - File reading (.docx, .txt, .pdf)
  • —pdf_generator.py - PDF report generation
  • —test_pipeline.py - Evaluation harness (183 expert-coded excerpts)
  • —DedooseChartExcerpts_2025_8_5_1025.xlsx - Ground truth data

Running the Evaluation

bash
# Structural tests (no API key needed)
python test_pipeline.py structural

# Test a single document through the LLM
python test_pipeline.py single Harold

# Full evaluation across all 23 documents
python test_pipeline.py full_eval