ogd
Datasets
All datasets matching “ogd”ogd4all-benchmark
OGD4All Benchmark
This is a 199-question benchmark that was used to evaluate the overall performance of OGD4All and different configurations (LLM, orchestration, ...).
OGD4All is an LLM-based prototype system enabling an easy-to-use, transparent interaction with Geospatial Open Government Data through natural language.
Each question requires GIS, SQL and/or topological operations on zero, one, or multiple datasets in GPKG or CSV formats to be answered.
Tasks
The… See the full description on the dataset page: https://huggingface.co/datasets/michael7ma/ogd4all-benchmark.ogd4all-zurich-ogdmp_mistral7bv3_sft_ogd_rms_epoch5_40k_multisample_n2mp_mistral7bv3_sft_ogd_rms_epoch5_40kmp_gemma9b_sft_ogd_rms_epoch4_40kmpg27_gemma9b_sft_ogd_rms_epoch5_40k_multisample_n2