rfr2003/GeoBenchLLM
🌍 GeoBenchLLM Benchmark Summary GeoBenchLLM aims to assess Large Language Models' (LLM) geographical abilities across a multitude of tasks. It is built from 12 datasets split across 8 differents tasks: Knowledge/Coordinates Prediction : GeoQuestions1089 Knowledge/Yes|No questions: GeoQuestions1089 Knowledge/Regression questions: GeoQuestions1089, GeoQuery Knowledge/Place Prediction: GeoQuestions1089, GeoQuery, Ms Marco Reasoning/Scenario Complex QA:… See the full description on the dataset page: https://huggingface.co/datasets/rfr2003/GeoBenchLLM.
Update README.md
Revert "updating logo and title in readme"
Updating git repo link
updating logo and title in readme
adding logo to readme.md
Changing repo name in readme
Correcting paths in PPNL_multi
Completing data fields
Adding data fields for datasets
Handling questions with multiple answers for SpatialEvalLLM
Get ridding of empty answers in TourismQA
Correcting little bug in GeoQuestions
Correcting conversion in GeoQuestions1089_regression
Changing column names NY-POI
Separating Scenario and Question in SpatialEvalLLM
Adding StepGame
Updating NY-POI
Removing __index_level_0__ from MsMarco
Removing __index_level_0__ in GeoSQA
Removing __index_level_0__ in GeoQuestions1089_place
Removing __index_level_0__ in GeoQuestions1089_regression
Removing __index_level_0__ in GeoQuestions1089_coord
Removing __index_level_0__ in GeoQuestions1089_YN
Removing column __index_level_0___ inGeoQuery_regression
Removing column __index_level_0___ inGeoQuery_place
Fixing type for GeoQuery_regression
Fixing type for GeoQuery_place
Fixing types in GeoQuestions1089_place
Fixing types in GeoQuestions1089_regression
Fixing types in GeoQuestions1089_coord
Fixing types in GeoQuestions1089_YN
Updating GeoQuestions1089_regression
Updating GeoQuestions1089_place
Updating GeoQuestions1089_coord
Updating GeoQuestions1089_YN
Adding NY-POI
Adding GeoQuestions1089_regression
Adding GeoQuestions1089_place
Adding GeoQuestions1089_coord
Adding GeoQuestions1089_YN
Adding README structure with first informations
Adding TourismQA
Adding MsMarco
Adding GeoQuery_regression
Adding GeoQuery_place
Updating PPNL multi
Updating PPNL single
Adding PPNL multi
Adding PPNL single
Updating SpartUN