anhaidgroup/polaris-arctic-v1

Arctic v1

Arctic is one of six datasets in [Polaris: Learning to Generate Table Descriptions from Retrieval Feedback](https://arxiv.org/abs/2608.17171), alongside aw, lter, ecir, wikitables, and wtr.

It holds 251 tables sampled at random from the Environmental Data Initiative (EDI), a repository of long-term ecological research data — lake water temperature, soil chemistry, rainfall, coral taxonomy — and 20 keyword queries over them. For each query–table pair, a person decided whether that table answers that query; those decisions are the relevance judgments, and they live in qrels.csv.

Each Polaris dataset comes in two versions. v1, this one, has the table metadata, the queries, and the relevance judgments. v2 adds the tuples — the contents of each table — and is at polaris-arctic-v2.

Files

`queries.csv` — one row per query.

query_id,query
q17,nitrous oxide
q8,average soil volumetric water content data: 2013 - ongoing

`qrels.csv` — one row per relevant pair, here the three tables relevant to q17.

query_id,table_id,relevance_score
q17,115,1
q17,185,1
q17,248,1

Judging was done by pooling: for each query, several retrievers proposed candidate tables and a person labelled each one, 1 for relevant and 0 for not. Only the 1s are listed here, so a table missing for a query counts as not relevant.

`metadata.csv` — one row per table, here the same three tables with their column lists cut short.

table_id,table_name,column_names
115,HBEF Ice Storm Trace Gas Data,"[""Project"", ""Year"", ..., ""CO2"", ""N2O"", ""CH4""]"
185,VCR09168_1,"[""YEAR"", ""DOY_JULIAN"", ""CO2_FLUX"", ""N2O_FLUX"", ...]"
248,subtgflx.pb.data.csv,"[""sample_date"", ""loc_code"", ""tmt_code"", ""N2O_flux"", ""CO2_flux""]"

Statistics

A table counts as gold if it scores above 0 for at least one query.

Download

The three files come to about 103 KB. You do not need a Hugging Face account to download them.

Option 1 — click the Files tab at the top of this page and save each file.

Option 2 — command line (recommended):

pip install huggingface_hub
hf download anhaidgroup/polaris-arctic-v1 --repo-type dataset --local-dir arctic

Polaris has six datasets in total and Arctic is one of them. Each sits in its own repository, so to download all six quickly — the v1 repositories, without tuples:

for d in aw arctic lter ecir wikitables wtr; do
  hf download anhaidgroup/polaris-$d-v1 --repo-type dataset --local-dir polaris_v1/$d
done

Usage

column_names is an array, so it needs parsing when you load the file. For example:

import ast
import pandas as pd

metadata = pd.read_csv("arctic/metadata.csv")
queries = pd.read_csv("arctic/queries.csv")
qrels = pd.read_csv("arctic/qrels.csv")

metadata["columns"] = metadata["column_names"].apply(ast.literal_eval)

relevant = qrels.loc[qrels.query_id == "q17", "table_id"].tolist()
# [115, 185, 248]

How is this dataset created?

The tables are a random sample of 251 tables from the Environmental Data Initiative, a scientific data repository that stores long-term ecological and environmental research data.

The Polaris authors wrote 20 queries covering topics such as precipitation, species diversity, and nitrous oxide. They then manually labelled the table–query pairs, giving a binary score of 0 or 1.

Citation

@misc{cai2026polaris,
  title         = {Polaris: Learning to Generate Table Descriptions from Retrieval Feedback},
  author        = {Cai, Ting and Phan, Tuan Minh and Doan, AnHai},
  year          = {2026},
  eprint        = {2608.17171},
  archivePrefix = {arXiv},
  primaryClass  = {cs.CL},
  doi           = {10.48550/arXiv.2608.17171},
  url           = {https://arxiv.org/abs/2608.17171}
}

Please also cite the source of the tables:

@misc{edi,
  author = {Paul Hanson},
  title  = {Environmental Data Initiative},
  year   = {2025},
  url    = {https://edirepository.org},
}

License

Contact

Email minhrua@cs.wisc.edu, valid until May 2029. After that, email anhai@cs.wisc.edu.