open-llm-leaderboard/comparator

Require login for MATH Details (#3)

Schedule Space restart to update list of models

Support comparing environmental impact

Fix loading message in case of timeout error

Implement retry mechanism when HTTP timeout error

Make the code robust against HTTP errors

Delete debugging prints

Support comparing model tree generations

Fix load_results for None data frames

Set result_paths_per_model as State

Minor fix

Improve async loading performance of Details

Support more than 2 models

Hide MATH fewshot_config.samples with memory address

Fix style

Add Download button

Avoid bug with radar plot

Plot also radar

Plot with plotly

Plot Results

Extract concat_results function

Rename dataframes

Sort 3/5/7 subtasks

Fix missing Snark subtask

Refactor glob to use the cache of HfFileSystem

Rename load file functions

Fix overflow on small screens

Update README.md

Align Details samples sorting by doc_id

Update README.md

Support loading LFS Details files

Support .json and .jsonl details files

Add explanation that login is required for GPQA Details

Change colormap to PiYG

Rename to Hide Standard Errors

Use color map for Results metrics values

Add checkbox in Details to show only differences

Add checkbox in Configs to show only differences

Add checkbox in Results to hide stderr

Implement login for GPQA Details

Fix loading Details with documents containing end of lines

Fix style

Fix wrapping to keep non-str data

Make beta-version warning less formal

Escape HTML tags in data

Fix URL to Leaderboard

Display loading message

Add additional info to task description

Import contants as submodule

Improve label of subtasks