Wrzzzrzr/open_medical_llm_leaderboard

Open Medical LLM Leaderboard

A comprehensive leaderboard for evaluating medical language models using the EleutherAI LM Evaluation Harness.

Features

• —Leaderboard Dashboard: Browse and search medical LLM benchmarks
• —Model Submission: Submit your models for evaluation
• —Queue Management: Track evaluation queue status (pending, running, completed)
• —Detailed Metrics: View model performance across multiple benchmarks

Running Locally

pip install -r requirements.txt
python app.py

The app will be available at http://localhost:7860

Configuration

Model and evaluation settings can be customized in src/env/ and src/about.py

Check out the configuration reference at https://huggingface.co/docs/hub/spaces-config-reference