iarcuschin/gemma-3-12b-it-lmsys-onpolicy-rollouts

On-policy chat rollouts: google/gemma-3-12b-it on LMSYS-Chat-1M prompts Each row is a first-user-turn prompt sampled from lmsys/lmsys-chat-1m and a response generated on-policy by google/gemma-3-12b-it with vLLM (do_sample, temperature 0.7, top_p 1.0, max_new_tokens 768, seed 42). 24,991 rows. Built to match GemmaScope 2's instruction-tuned SAE training distribution (real model rollouts) for a short KL+MSE ("end-to-end") finetune of the released GemmaScope-2 residual SAE.… See the full description on the dataset page: https://huggingface.co/datasets/iarcuschin/gemma-3-12b-it-lmsys-onpolicy-rollouts.