CoolFace
Apppublic

delgesem/constitutional-climate-fact-checker

sourceHugging Faceupdated 15d agoView on Hugging Face
0likes
App README

Constitutional Climate Fact-Checker

An AI fact-checking system for climate claims, governed by a constitution of 27 codified principles encoding professional fact-checking norms. Built for professional fact-checkers to evaluate: every verdict is accompanied by the full tool trace, the evidence gathered, and a calibrated confidence.

Required configuration

Set these under Settings → Variables and secrets before the Space will run.

Secrets

NamePurpose
ANTHROPIC_API_KEYRequired. The model that runs the fact-check.
HF_TOKENRequired. Read access to the two private model repos below. Without it both tools fall back to base models.
SERPER_API_KEYOptional. Without it, web_search falls back to DuckDuckGo, which is not the backend used for the reported evaluation.
APP_PASSWORDOptional. When set, gates the app behind a shared password. Leave unset for a private Space; set it if the Space is public.

Variables

NameValue
CLIMATE_NLI_MODEL_PATHdelgesem/climatecheck-nli-finetuned
CLIMATE_MYTH_EMBEDDERdelgesem/climate-bge-finetuned

If either variable is unset the corresponding tool silently substitutes a base model, which changes results. The sidebar reports which model each tool is actually running — check it after the first boot rather than assuming.

Pipeline fidelity

Three of the four local tools run exactly the models used in the reported evaluation:

ToolThis SpaceEvaluated pipeline
myth_detectfine-tuned BGE + FAISS indexsame
rag_searchall-mpnet-base-v2 + curated indexsame
nli_evaluateClimateCheck fine-tuned DeBERTasame
claim_splitrule-based conjunction splittingfine-tuned Qwen LoRA (needs a GPU)

claim_split is the exception: the fine-tuned Qwen splitter requires CUDA, which a CPU Space does not have, so it falls back to rule-based decomposition. The sidebar shows a warning while this is active. Claim decomposition will differ from the reported results; the other three tools will not.

Curated evidence index

rag_search retrieves from Global Tipping Points 2025, WMO State of the Global Climate 2024, WMO COP30 update 2025, and Copernicus 2025.