datasets
Training and evaluation data, with the modality, task and licence stated up front. Listed live from the Hugging Face Hub.
llama-3.1-8b-funding-extraction-sft-ablations
LLaMA 3.1 8B Funding Extraction SFT Ablations
Ablation study results for LoRA SFT of Meta LLaMA 3.1 8B Instruct on structured funding metadata extraction from scholarly text.
The model extracts four fields: funder_name, award_ids, funding_scheme, and award_title.
Key findings
Factor
Best config
Avg F1
Overall best
synthetic, twostage (2+1 epochs), LoRA r=64, lr=3e-5
0.588
Data type
Synthetic >> non-synthetic (+0.126 avg F1)
—
LoRA rank
r=64 > r=32 > r=16
—… See the full description on the dataset page: https://huggingface.co/datasets/cometadata/llama-3.1-8b-funding-extraction-sft-ablations.ablation-eval
Lean Proof-Ablation Eval
Syntactic proof-ablation challenges from 57 real Lean 4 repositories
(compilers, cryptography, distributed protocols, zk circuits, program logics —
see the repo list below). Each record is a (challenge, solution) pair: the
challenge is a real source file with one or more lemmas deleted and their
in-file users holed (sorry); the solution is the original file. A solver
must re-derive the deleted lemma(s) and close the holes so the file compiles.
Every… See the full description on the dataset page: https://huggingface.co/datasets/for-all-dev/ablation-eval.