prompt-sensitivity
Paraphrased_Opinion_Prompt_Sensitivity_Dataset_POPSprompt-sensitivity-codegen
Prompt Sensitivity in Few-Shot Code Generation Dataset
This dataset contains the full generated-code outputs and pass/fail outcomes used in
our prompt sensitivity study across model families, benchmarks, perturbation axes,
and k-shot settings.
Dataset summary
Rows: 240000
Models: claude-sonnet-4, gemini-2.5-flash, gpt-4o, llama-3.3-70b, qwen2.5-coder-3b
Benchmarks: humaneval, mbpp
Axes: order, phrasing, style
k-shot values: 0, 1, 2, 3
Hugging Face repo:… See the full description on the dataset page: https://huggingface.co/datasets/daksh76/prompt-sensitivity-codegen.prompt-sensitivity-codegen
Anonymous Prompt Sensitivity Dataset
This package contains model generations and evaluation outcomes for an anonymized
submission on prompt sensitivity in few-shot code generation.
What is included
prompt_sensitivity_dataset.jsonl: one row per generated sample
prompt_sensitivity_dataset.csv: tabular view of the same rows
prompt_sensitivity_dataset.parquet: columnar copy when parquet support is available
prompt_variant_spec.json: machine-readable description of the prompt… See the full description on the dataset page: https://huggingface.co/datasets/anonymous-acl26/prompt-sensitivity-codegen.