lemma
Datasets
All datasets matching “lemma”lemmanaid-afp-reruns
Lemmanaid AFP-pool Reproducibility Reruns
Reproducibility study for claude-opus-4-5 on the yalhessi/lemexp-commerical-llm-experiment benchmark, using an AFP demo pool (honest eval — no train/test theory leakage).
Companion to ggranberry/lemmanaid-commercial-results, which holds the earlier shot-count + retrieval sweeps under test-LOO.
Configs
Two configs, one per benchmark domain:
Config
Source HF config
Test rows
octonions
template_octonions_2026… See the full description on the dataset page: https://huggingface.co/datasets/ggranberry/lemmanaid-afp-reruns.renderer_test_datasetIMO-Lemmas
Tencent-IMO: Towards Solving More Challenging IMO Problems via Decoupled Reasoning and Proving
This dataset contains strategic subgoals (lemmas) and their formal proofs for a challenging set of post-2000 International Mathematical Olympiad (IMO) problems. All statements and proofs are formalized in the Lean 4 theorem proving language.
The data was generated using the Decoupled Reasoning and Proving framework, introduced in our paper: Towards Solving More Challenging IMO Problems… See the full description on the dataset page: https://huggingface.co/datasets/Tencent-IMO/IMO-Lemmas.lemma-long-horizon-rewrite-benchmark
LEMMA Long-Horizon Symbolic Rewriting Benchmark
Rewrite one expression into another, one verified step at a time — for up to 128 steps.
Every problem gives you a start expression, an exact target, and a reference derivation in which
every single step was accepted by a symbolic verifier. The hard part is not any individual
rewrite. It is picking the right rewrite at each of up to 128 consecutive states, where a
plausible-looking legal move can quietly take you away from the… See the full description on the dataset page: https://huggingface.co/datasets/BlackdromeAILabs/lemma-long-horizon-rewrite-benchmark.tcs_find_lemmaCloud_Computing_Preprocessed
Data Description:
Preprocessed system metrics and log data from Cloud Computing Platform.
Constructed the metric time series (as npy format) from the original metrics data (Json format).
Extracted the log messages from the original log data (Json format). Parsed the log messages into log event templates.
Note: 20240207 data does not contain EKS log data; it solely comprises CloudTrail log data in CSV format. Consequently, this dataset does not require preprocessing with a log… See the full description on the dataset page: https://huggingface.co/datasets/Lemma-RCA-NEC/Cloud_Computing_Preprocessed.