Datasetpublic
kobzaond/RLVRAMBench

RLVRAMBench Which language-model training configurations can I use with the memory I have, and how much testing does that decision require? RLVRAMBench is a measurement dataset with open evaluation tasks for a specific language-model training system. It measures memory feasibility when response generation and reinforcement-learning updates share the same graphics processors. It provides measured outcomes, fixed prediction tasks, a budgeted decision replay, reference methods, and… See the full description on the dataset page: https://huggingface.co/datasets/kobzaond/RLVRAMBench.
sourceHugging Facemitupdated 9d agoView on Hugging Face
0likes223downloads
rootbenchmarktransfer_configurations.csv
transfer_configurations.csv100 linesDownload Raw Back to benchmark
1model_name,workload_name,gpu_count,total_training_steps,configuration_level,actor_micro_batch,vllm_gpu_memory_utilization,observed_state,eligible_processes,completed_eligible_processes,within_margin_processes,max_completed_run_peak_mib,margin_limit_mib,recorded_attempts,configuration_id,case_id,study,model_family,model_id,workload_id,legacy_dataset_id,algorithm,adaptation,condition,rollout_tp_size,rollout_logprob_micro_batch,ref_logprob_micro_batch,parameter_offload,optimizer_offload,free_cache_engine,max_prompt_length,max_response_length,max_model_len,max_num_seqs,rollout_n,train_batch_size,train_max_samples,val_max_samples,gpu_monitor_interval_ms,allocator_trace_enabled,allocator_trace_sync,save_freq,test_freq,val_before_train,resume_mode,max_actor_ckpt_to_keep,accelerator,device_capacity_mib,peak_measurement,distinct_seeds,above_margin_processes,memory_failure_processes,mean_completed_run_peak_mib,documented_completed_attempts,excluded_attempts,label_scope,used_in_transfer_tasks2Phi-4-mini-instruct,MATH mathematics,4,1,c3,16,0.7,within_margin,3,3,3,36204.0,38912,3,cfg-072bd7669d20f8fa,case-9edcd27bfa38bde6,four_gpu,phi4_mini,microsoft/Phi-4-mini-instruct,math,math,GRPO,LoRA,four_gpu,1,8,8,False,False,True,512,512,1024,128,2,64,64,64,100,True,1,-1,-1,False,disable,1,NVIDIA A100-SXM4-40GB,40960,maximum externally sampled per-device memory,3,0,0,36204.0,3,0,eligible_resource_outcomes,13Qwen2.5-3B-Instruct,Standard code,2,1,c3,16,0.7,within_margin,3,3,3,37418.0,38912,3,cfg-0d9ba9215ab5683e,case-3b29fa0f8aca4ad8,boundary,qwen25_3b,Qwen/Qwen2.5-3B-Instruct,code_standard,code_standard,GRPO,LoRA,,1,4,4,False,False,True,640,1024,1664,64,2,32,32,32,100,,,,,,,,NVIDIA A100-SXM4-40GB,40960,maximum externally sampled per-device memory,3,0,0,37416.0,3,0,eligible_resource_outcomes,14Phi-4-mini-instruct,MATH mathematics,2,1,c2,8,0.6,within_margin,3,3,3,35920.0,38912,3,cfg-0f540d3f6fe4661b,case-72e234e68dbd93fc,boundary,phi4_mini,microsoft/Phi-4-mini-instruct,math,math,GRPO,LoRA,,1,8,8,False,False,True,512,512,1024,128,2,64,64,64,100,,,,,,,,NVIDIA A100-SXM4-40GB,40960,maximum externally sampled per-device memory,3,0,0,35920.0,3,0,eligible_resource_outcomes,15Phi-4-mini-instruct,MATH mathematics,2,1,c1,4,0.45,within_margin,3,3,3,26348.0,38912,3,cfg-0f8a31ef7ac4c551,case-72e234e68dbd93fc,boundary,phi4_mini,microsoft/Phi-4-mini-instruct,math,math,GRPO,LoRA,,1,8,8,True,False,True,512,512,1024,128,2,64,64,64,100,,,,,,,,NVIDIA A100-SXM4-40GB,40960,maximum externally sampled per-device memory,3,0,0,26348.0,3,0,eligible_resource_outcomes,16Phi-4-mini-instruct,Longer-prompt code,2,1,c5,32,0.85,memory_failure,3,0,0,,38912,3,cfg-10644b5d0a82d5c3,case-0cbe32dd0cd7439d,boundary,phi4_mini,microsoft/Phi-4-mini-instruct,longer_prompt_code,code_heavy_tail,GRPO,LoRA,,1,4,4,False,False,True,1536,1024,2560,64,2,32,32,32,100,,,,,,,,NVIDIA A100-SXM4-40GB,40960,maximum externally sampled per-device memory,3,0,3,,0,0,eligible_resource_outcomes,17Phi-4-mini-instruct,MATH mathematics,4,1,c4,16,0.8,above_margin,3,3,0,40236.0,38912,3,cfg-1432bb8a4d9c3b8c,case-9edcd27bfa38bde6,four_gpu,phi4_mini,microsoft/Phi-4-mini-instruct,math,math,GRPO,LoRA,four_gpu,1,8,8,False,False,True,512,512,1024,128,2,64,64,64,100,True,1,-1,-1,False,disable,1,NVIDIA A100-SXM4-40GB,40960,maximum externally sampled per-device memory,3,3,0,40236.0,3,0,eligible_resource_outcomes,18Phi-4-mini-instruct,GSM8K mathematics,4,1,c3,16,0.7,within_margin,3,3,3,35730.0,38912,3,cfg-17e69bcf1b041bd9,case-b192d6c84c26b05b,four_gpu,phi4_mini,microsoft/Phi-4-mini-instruct,gsm8k,gsm8k,GRPO,LoRA,four_gpu,1,4,4,False,False,True,1024,2048,3072,64,2,32,32,32,100,True,1,-1,-1,False,disable,1,NVIDIA A100-SXM4-40GB,40960,maximum externally sampled per-device memory,3,0,0,35710.0,3,0,eligible_resource_outcomes,19Phi-4-mini-instruct,Longer-prompt code,2,1,c1,4,0.45,within_margin,3,3,3,26056.0,38912,3,cfg-18285c3cb50308d4,case-0cbe32dd0cd7439d,boundary,phi4_mini,microsoft/Phi-4-mini-instruct,longer_prompt_code,code_heavy_tail,GRPO,LoRA,,1,4,4,True,False,True,1536,1024,2560,64,2,32,32,32,100,,,,,,,,NVIDIA A100-SXM4-40GB,40960,maximum externally sampled per-device memory,3,0,0,26056.0,3,0,eligible_resource_outcomes,110Granite-3.3-2B-Instruct,MATH mathematics,2,1,interpolated_boundary,16,0.75,above_margin,3,3,2,40898.0,38912,3,cfg-195974eaa7e946e0,case-eea4168be2efa3f0,horizon_followup,granite33_2b,ibm-granite/granite-3.3-2b-instruct,math,math,GRPO,LoRA,source,1,8,8,False,False,True,512,512,1024,128,2,64,-1,64,100,True,1,25,20,True,disable,1,NVIDIA A100-SXM4-40GB,40960,maximum externally sampled per-device memory,3,1,0,39535.333333333336,3,0,eligible_resource_outcomes,111Qwen2.5-3B-Instruct,Longer-prompt code,2,1,c3,16,0.7,within_margin,3,3,3,37682.0,38912,4,cfg-1c5278f8be90a50a,case-f465ad721b3d7997,boundary,qwen25_3b,Qwen/Qwen2.5-3B-Instruct,longer_prompt_code,code_heavy_tail,GRPO,LoRA,,1,4,4,False,False,True,1536,1024,2560,64,2,32,32,32,100,,,,,,,,NVIDIA A100-SXM4-40GB,40960,maximum externally sampled per-device memory,3,0,0,37464.666666666664,3,1,eligible_resource_outcomes,112Granite-3.3-2B-Instruct,MATH mathematics,4,1,c3,16,0.7,within_margin,3,3,3,34068.0,38912,3,cfg-2afbe250af9cd3e1,case-4b10c2bfe26b9b30,four_gpu,granite33_2b,ibm-granite/granite-3.3-2b-instruct,math,math,GRPO,LoRA,four_gpu,1,8,8,False,False,True,512,512,1024,128,2,64,256,64,100,True,1,-1,-1,False,disable,1,NVIDIA A100-SXM4-40GB,40960,maximum externally sampled per-device memory,3,0,0,34061.333333333336,3,0,eligible_resource_outcomes,113Phi-4-mini-instruct,GSM8K mathematics,4,1,c2,8,0.6,within_margin,3,3,3,31658.0,38912,3,cfg-301e4dae7048c6ec,case-b192d6c84c26b05b,four_gpu,phi4_mini,microsoft/Phi-4-mini-instruct,gsm8k,gsm8k,GRPO,LoRA,four_gpu,1,4,4,False,False,True,1024,2048,3072,64,2,32,32,32,100,True,1,-1,-1,False,disable,1,NVIDIA A100-SXM4-40GB,40960,maximum externally sampled per-device memory,3,0,0,31658.0,3,0,eligible_resource_outcomes,114Qwen2.5-3B-Instruct,MATH mathematics,2,1,c2,8,0.6,within_margin,3,3,3,33446.0,38912,3,cfg-30f98456fdb322c1,case-4292ea81ce5a0a8a,boundary,qwen25_3b,Qwen/Qwen2.5-3B-Instruct,math,math,GRPO,LoRA,,1,8,8,False,False,True,512,512,1024,128,2,64,64,64,100,,,,,,,,NVIDIA A100-SXM4-40GB,40960,maximum externally sampled per-device memory,3,0,0,33446.0,3,0,eligible_resource_outcomes,115Phi-4-mini-instruct,MATH mathematics,2,1,interpolated_boundary,16,0.65,within_margin,3,3,3,37968.0,38912,3,cfg-3171760c4182a3cf,case-4d982363eb76a344,horizon_followup,phi4_mini,microsoft/Phi-4-mini-instruct,math,math,GRPO,LoRA,source,1,8,8,False,False,True,512,512,1024,128,2,64,-1,64,100,True,1,25,20,True,disable,1,NVIDIA A100-SXM4-40GB,40960,maximum externally sampled per-device memory,3,0,0,37968.0,3,0,eligible_resource_outcomes,116Granite-3.3-2B-Instruct,MATH mathematics,2,100,interpolated_boundary,16,0.75,above_margin,3,3,0,39410.0,38912,3,cfg-3197439008c27071,case-071e487c551d1e8b,horizon_followup,granite33_2b,ibm-granite/granite-3.3-2b-instruct,math,math,GRPO,LoRA,long,1,8,8,False,False,True,512,512,1024,128,2,64,-1,64,100,True,1,25,20,True,disable,1,NVIDIA A100-SXM4-40GB,40960,maximum externally sampled per-device memory,3,3,0,39407.333333333336,3,0,eligible_resource_outcomes,117Granite-3.3-2B-Instruct,MATH mathematics,2,1,c5,32,0.85,memory_failure,3,0,0,,38912,5,cfg-32977d5aa42a41cb,case-8a509de3be5cc9c0,boundary,granite33_2b,ibm-granite/granite-3.3-2b-instruct,math,math,GRPO,LoRA,,1,8,8,False,False,True,512,512,1024,128,2,64,256,64,100,,,,,,,,NVIDIA A100-SXM4-40GB,40960,maximum externally sampled per-device memory,3,0,3,,0,2,eligible_resource_outcomes,118Qwen2.5-3B-Instruct,GSM8K mathematics,2,1,c2,8,0.6,within_margin,3,3,3,33108.0,38912,3,cfg-338d9224eb9d2f3a,case-63523914ab4f2ca0,boundary,qwen25_3b,Qwen/Qwen2.5-3B-Instruct,gsm8k,gsm8k,GRPO,LoRA,,1,4,4,False,False,True,1024,2048,3072,64,2,32,32,32,100,,,,,,,,NVIDIA A100-SXM4-40GB,40960,maximum externally sampled per-device memory,3,0,0,33108.0,3,0,eligible_resource_outcomes,119Qwen2.5-3B-Instruct,GSM8K mathematics,2,1,c5,32,0.85,memory_failure,3,0,0,,38912,3,cfg-352f4dbc55fbcd3c,case-63523914ab4f2ca0,boundary,qwen25_3b,Qwen/Qwen2.5-3B-Instruct,gsm8k,gsm8k,GRPO,LoRA,,1,4,4,False,False,True,1024,2048,3072,64,2,32,32,32,100,,,,,,,,NVIDIA A100-SXM4-40GB,40960,maximum externally sampled per-device memory,3,0,3,,0,0,eligible_resource_outcomes,120Phi-4-mini-instruct,MATH mathematics,4,1,c2,8,0.6,within_margin,3,3,3,32108.0,38912,3,cfg-371ae37408089efe,case-9edcd27bfa38bde6,four_gpu,phi4_mini,microsoft/Phi-4-mini-instruct,math,math,GRPO,LoRA,four_gpu,1,8,8,False,False,True,512,512,1024,128,2,64,64,64,100,True,1,-1,-1,False,disable,1,NVIDIA A100-SXM4-40GB,40960,maximum externally sampled per-device memory,3,0,0,32108.0,3,0,eligible_resource_outcomes,121Qwen2.5-3B-Instruct,GSM8K mathematics,4,1,c2,8,0.6,within_margin,3,3,3,29840.0,38912,6,cfg-399f6b038d6f65f9,case-51d35057c79e5d8c,four_gpu,qwen25_3b,Qwen/Qwen2.5-3B-Instruct,gsm8k,gsm8k,GRPO,LoRA,four_gpu,1,4,4,False,False,True,1024,2048,3072,64,2,32,32,32,100,True,1,-1,-1,False,disable,1,NVIDIA A100-SXM4-40GB,40960,maximum externally sampled per-device memory,3,0,0,29826.666666666668,3,3,eligible_resource_outcomes,122Phi-4-mini-instruct,GSM8K mathematics,2,1,c5,32,0.85,memory_failure,3,0,0,,38912,3,cfg-3c86a11fdb8455cb,case-abb8a07d13eb7634,boundary,phi4_mini,microsoft/Phi-4-mini-instruct,gsm8k,gsm8k,GRPO,LoRA,,1,4,4,False,False,True,1024,2048,3072,64,2,32,32,32,100,,,,,,,,NVIDIA A100-SXM4-40GB,40960,maximum externally sampled per-device memory,3,0,3,,0,0,eligible_resource_outcomes,123Granite-3.3-2B-Instruct,Longer-prompt code,2,1,c5,32,0.85,memory_failure,3,0,0,,38912,3,cfg-3dc042a103546eac,case-201b7a50ed47a7dd,boundary,granite33_2b,ibm-granite/granite-3.3-2b-instruct,longer_prompt_code,code_heavy_tail,GRPO,LoRA,,1,4,4,False,False,True,1536,1024,2560,64,2,32,128,32,100,,,,,,,,NVIDIA A100-SXM4-40GB,40960,maximum externally sampled per-device memory,3,0,3,,0,0,eligible_resource_outcomes,124Qwen2.5-3B-Instruct,MATH mathematics,2,1,c0,1,0.3,within_margin,3,3,3,21860.0,38912,3,cfg-3f0f48a3c570a0c8,case-4292ea81ce5a0a8a,boundary,qwen25_3b,Qwen/Qwen2.5-3B-Instruct,math,math,GRPO,LoRA,,1,8,8,True,False,True,512,512,1024,128,2,64,64,64,100,,,,,,,,NVIDIA A100-SXM4-40GB,40960,maximum externally sampled per-device memory,3,0,0,21860.0,3,0,eligible_resource_outcomes,125Qwen2.5-3B-Instruct,Longer-prompt code,2,1,c4,16,0.8,memory_failure,3,0,0,,38912,3,cfg-49d9bccfe873f5c6,case-f465ad721b3d7997,boundary,qwen25_3b,Qwen/Qwen2.5-3B-Instruct,longer_prompt_code,code_heavy_tail,GRPO,LoRA,,1,4,4,False,False,True,1536,1024,2560,64,2,32,32,32,100,,,,,,,,NVIDIA A100-SXM4-40GB,40960,maximum externally sampled per-device memory,3,0,3,,0,0,eligible_resource_outcomes,126Qwen2.5-3B-Instruct,GSM8K mathematics,2,1,c0,1,0.3,within_margin,3,3,3,21560.0,38912,3,cfg-5244d13eac3116ad,case-63523914ab4f2ca0,boundary,qwen25_3b,Qwen/Qwen2.5-3B-Instruct,gsm8k,gsm8k,GRPO,LoRA,,1,4,4,True,False,True,1024,2048,3072,64,2,32,32,32,100,,,,,,,,NVIDIA A100-SXM4-40GB,40960,maximum externally sampled per-device memory,3,0,0,21546.666666666668,3,0,eligible_resource_outcomes,127Qwen2.5-3B-Instruct,MATH mathematics,2,1,c4,16,0.8,memory_failure,3,0,0,,38912,3,cfg-55811d23c5144bb7,case-4292ea81ce5a0a8a,boundary,qwen25_3b,Qwen/Qwen2.5-3B-Instruct,math,math,GRPO,LoRA,,1,8,8,False,False,True,512,512,1024,128,2,64,64,64,100,,,,,,,,NVIDIA A100-SXM4-40GB,40960,maximum externally sampled per-device memory,3,0,3,,0,0,eligible_resource_outcomes,128Qwen2.5-3B-Instruct,GSM8K mathematics,2,1,c4,16,0.8,memory_failure,3,0,0,,38912,3,cfg-5839ccf95c2c1722,case-63523914ab4f2ca0,boundary,qwen25_3b,Qwen/Qwen2.5-3B-Instruct,gsm8k,gsm8k,GRPO,LoRA,,1,4,4,False,False,True,1024,2048,3072,64,2,32,32,32,100,,,,,,,,NVIDIA A100-SXM4-40GB,40960,maximum externally sampled per-device memory,3,0,3,,0,0,eligible_resource_outcomes,129Phi-4-mini-instruct,GSM8K mathematics,4,1,c4,16,0.8,above_margin,3,3,0,39806.0,38912,3,cfg-5ff9621270e710ed,case-b192d6c84c26b05b,four_gpu,phi4_mini,microsoft/Phi-4-mini-instruct,gsm8k,gsm8k,GRPO,LoRA,four_gpu,1,4,4,False,False,True,1024,2048,3072,64,2,32,32,32,100,True,1,-1,-1,False,disable,1,NVIDIA A100-SXM4-40GB,40960,maximum externally sampled per-device memory,3,3,0,39792.666666666664,3,0,eligible_resource_outcomes,130Granite-3.3-2B-Instruct,Standard code,2,1,c4,16,0.8,above_margin,3,3,0,40616.0,38912,6,cfg-61c14de21a34d0e6,case-b2740e83619312c4,boundary,granite33_2b,ibm-granite/granite-3.3-2b-instruct,code_standard,code_standard,GRPO,LoRA,,1,4,4,False,False,True,640,1024,1664,64,2,32,128,32,100,,,,,,,,NVIDIA A100-SXM4-40GB,40960,maximum externally sampled per-device memory,3,3,0,40606.666666666664,3,3,eligible_resource_outcomes,131Qwen2.5-3B-Instruct,MATH mathematics,2,1,c1,4,0.45,within_margin,3,3,3,21900.0,38912,3,cfg-62f371a80968a0ba,case-4292ea81ce5a0a8a,boundary,qwen25_3b,Qwen/Qwen2.5-3B-Instruct,math,math,GRPO,LoRA,,1,8,8,True,False,True,512,512,1024,128,2,64,64,64,100,,,,,,,,NVIDIA A100-SXM4-40GB,40960,maximum externally sampled per-device memory,3,0,0,21893.333333333332,3,0,eligible_resource_outcomes,132Granite-3.3-2B-Instruct,GSM8K mathematics,2,1,c4,16,0.8,above_margin,3,3,0,40382.0,38912,3,cfg-6a4562db98b38d6f,case-ab5bfd69a29741ce,boundary,granite33_2b,ibm-granite/granite-3.3-2b-instruct,gsm8k,gsm8k,GRPO,LoRA,,1,4,4,False,False,True,1024,2048,3072,64,2,32,128,32,100,,,,,,,,NVIDIA A100-SXM4-40GB,40960,maximum externally sampled per-device memory,3,3,0,40382.0,3,0,eligible_resource_outcomes,133Qwen2.5-3B-Instruct,Standard code,2,1,c2,8,0.6,within_margin,3,3,3,33388.0,38912,3,cfg-6d54ac65d934f404,case-3b29fa0f8aca4ad8,boundary,qwen25_3b,Qwen/Qwen2.5-3B-Instruct,code_standard,code_standard,GRPO,LoRA,,1,4,4,False,False,True,640,1024,1664,64,2,32,32,32,100,,,,,,,,NVIDIA A100-SXM4-40GB,40960,maximum externally sampled per-device memory,3,0,0,33232.0,3,0,eligible_resource_outcomes,134Qwen2.5-3B-Instruct,MATH mathematics,4,1,c3,16,0.7,within_margin,3,3,3,34212.0,38912,3,cfg-714c540f76d9525d,case-398e989379a2ea29,four_gpu,qwen25_3b,Qwen/Qwen2.5-3B-Instruct,math,math,GRPO,LoRA,four_gpu,1,8,8,False,False,True,512,512,1024,128,2,64,64,64,100,True,1,-1,-1,False,disable,1,NVIDIA A100-SXM4-40GB,40960,maximum externally sampled per-device memory,3,0,0,34211.333333333336,3,0,eligible_resource_outcomes,135Granite-3.3-2B-Instruct,GSM8K mathematics,2,1,c3,16,0.7,within_margin,3,3,3,36302.0,38912,3,cfg-73c06764ba28a56b,case-ab5bfd69a29741ce,boundary,granite33_2b,ibm-granite/granite-3.3-2b-instruct,gsm8k,gsm8k,GRPO,LoRA,,1,4,4,False,False,True,1024,2048,3072,64,2,32,128,32,100,,,,,,,,NVIDIA A100-SXM4-40GB,40960,maximum externally sampled per-device memory,3,0,0,36302.0,3,0,eligible_resource_outcomes,136Qwen2.5-3B-Instruct,GSM8K mathematics,4,1,c4,16,0.8,within_margin,3,3,3,37976.0,38912,3,cfg-78c440d3891ddbc2,case-51d35057c79e5d8c,four_gpu,qwen25_3b,Qwen/Qwen2.5-3B-Instruct,gsm8k,gsm8k,GRPO,LoRA,four_gpu,1,4,4,False,False,True,1024,2048,3072,64,2,32,32,32,100,True,1,-1,-1,False,disable,1,NVIDIA A100-SXM4-40GB,40960,maximum externally sampled per-device memory,3,0,0,37969.333333333336,3,0,eligible_resource_outcomes,137Granite-3.3-2B-Instruct,Longer-prompt code,2,1,c0,1,0.3,within_margin,3,3,3,19070.0,38912,3,cfg-7a0e81934d3398ee,case-201b7a50ed47a7dd,boundary,granite33_2b,ibm-granite/granite-3.3-2b-instruct,longer_prompt_code,code_heavy_tail,GRPO,LoRA,,1,4,4,True,False,True,1536,1024,2560,64,2,32,128,32,100,,,,,,,,NVIDIA A100-SXM4-40GB,40960,maximum externally sampled per-device memory,3,0,0,19070.0,3,0,eligible_resource_outcomes,138Qwen2.5-3B-Instruct,GSM8K mathematics,2,1,c3,16,0.7,within_margin,3,3,3,37140.0,38912,3,cfg-7a9a974958c57abc,case-63523914ab4f2ca0,boundary,qwen25_3b,Qwen/Qwen2.5-3B-Instruct,gsm8k,gsm8k,GRPO,LoRA,,1,4,4,False,False,True,1024,2048,3072,64,2,32,32,32,100,,,,,,,,NVIDIA A100-SXM4-40GB,40960,maximum externally sampled per-device memory,3,0,0,37140.0,3,0,eligible_resource_outcomes,139Phi-4-mini-instruct,GSM8K mathematics,2,1,interpolated_boundary,16,0.65,within_margin,3,3,3,37588.0,38912,6,cfg-7d5384d3ac8311c8,case-3168faf5c1fef9b2,horizon_followup,phi4_mini,microsoft/Phi-4-mini-instruct,gsm8k,gsm8k,GRPO,LoRA,source,1,4,4,False,False,True,1024,2048,3072,64,2,32,-1,32,100,True,1,25,20,True,disable,1,NVIDIA A100-SXM4-40GB,40960,maximum externally sampled per-device memory,3,0,0,37576.0,3,3,eligible_resource_outcomes,140Phi-4-mini-instruct,Longer-prompt code,2,1,c4,16,0.8,memory_failure,3,0,0,,38912,3,cfg-7df2428553b76877,case-0cbe32dd0cd7439d,boundary,phi4_mini,microsoft/Phi-4-mini-instruct,longer_prompt_code,code_heavy_tail,GRPO,LoRA,,1,4,4,False,False,True,1536,1024,2560,64,2,32,32,32,100,,,,,,,,NVIDIA A100-SXM4-40GB,40960,maximum externally sampled per-device memory,3,0,3,,0,0,eligible_resource_outcomes,141Granite-3.3-2B-Instruct,Standard code,2,1,c5,32,0.85,memory_failure,3,0,0,,38912,3,cfg-7f23cab692546e3f,case-b2740e83619312c4,boundary,granite33_2b,ibm-granite/granite-3.3-2b-instruct,code_standard,code_standard,GRPO,LoRA,,1,4,4,False,False,True,640,1024,1664,64,2,32,128,32,100,,,,,,,,NVIDIA A100-SXM4-40GB,40960,maximum externally sampled per-device memory,3,0,3,,0,0,eligible_resource_outcomes,142Phi-4-mini-instruct,MATH mathematics,2,100,interpolated_boundary,16,0.65,within_margin,3,3,3,38534.0,38912,3,cfg-818aa43be2ebba5e,case-4f7489c4b7b2a3a4,horizon_followup,phi4_mini,microsoft/Phi-4-mini-instruct,math,math,GRPO,LoRA,long,1,8,8,False,False,True,512,512,1024,128,2,64,-1,64,100,True,1,25,20,True,disable,1,NVIDIA A100-SXM4-40GB,40960,maximum externally sampled per-device memory,3,0,0,38506.666666666664,3,0,eligible_resource_outcomes,143Granite-3.3-2B-Instruct,MATH mathematics,2,1,c3,16,0.7,within_margin,3,3,3,38718.0,38912,6,cfg-835067f7405e89a2,case-8a509de3be5cc9c0,boundary,granite33_2b,ibm-granite/granite-3.3-2b-instruct,math,math,GRPO,LoRA,,1,8,8,False,False,True,512,512,1024,128,2,64,256,64,100,,,,,,,,NVIDIA A100-SXM4-40GB,40960,maximum externally sampled per-device memory,3,0,0,37352.666666666664,3,3,eligible_resource_outcomes,144Phi-4-mini-instruct,Standard code,2,1,c5,32,0.85,memory_failure,3,0,0,,38912,3,cfg-896685010703c0fb,case-9016781c2a452d34,boundary,phi4_mini,microsoft/Phi-4-mini-instruct,code_standard,code_standard,GRPO,LoRA,,1,4,4,False,False,True,640,1024,1664,64,2,32,32,32,100,,,,,,,,NVIDIA A100-SXM4-40GB,40960,maximum externally sampled per-device memory,3,0,3,,0,0,eligible_resource_outcomes,145Phi-4-mini-instruct,Longer-prompt code,2,1,c3,16,0.7,above_margin,3,3,0,40112.0,38912,3,cfg-89ca48ce88ea694e,case-0cbe32dd0cd7439d,boundary,phi4_mini,microsoft/Phi-4-mini-instruct,longer_prompt_code,code_heavy_tail,GRPO,LoRA,,1,4,4,False,False,True,1536,1024,2560,64,2,32,32,32,100,,,,,,,,NVIDIA A100-SXM4-40GB,40960,maximum externally sampled per-device memory,3,3,0,40056.666666666664,3,0,eligible_resource_outcomes,146Phi-4-mini-instruct,GSM8K mathematics,2,1,c0,1,0.3,within_margin,3,3,3,26036.0,38912,3,cfg-8bd7050cd7f49e78,case-abb8a07d13eb7634,boundary,phi4_mini,microsoft/Phi-4-mini-instruct,gsm8k,gsm8k,GRPO,LoRA,,1,4,4,True,False,True,1024,2048,3072,64,2,32,32,32,100,,,,,,,,NVIDIA A100-SXM4-40GB,40960,maximum externally sampled per-device memory,3,0,0,26034.666666666668,3,0,eligible_resource_outcomes,147Qwen2.5-3B-Instruct,Standard code,2,1,c0,1,0.3,within_margin,3,3,3,21560.0,38912,3,cfg-9160dc45a0171a10,case-3b29fa0f8aca4ad8,boundary,qwen25_3b,Qwen/Qwen2.5-3B-Instruct,code_standard,code_standard,GRPO,LoRA,,1,4,4,True,False,True,640,1024,1664,64,2,32,32,32,100,,,,,,,,NVIDIA A100-SXM4-40GB,40960,maximum externally sampled per-device memory,3,0,0,21553.333333333332,3,0,eligible_resource_outcomes,148Granite-3.3-2B-Instruct,Longer-prompt code,2,1,c4,16,0.8,above_margin,3,3,0,40650.0,38912,3,cfg-93d4f41e600c9079,case-201b7a50ed47a7dd,boundary,granite33_2b,ibm-granite/granite-3.3-2b-instruct,longer_prompt_code,code_heavy_tail,GRPO,LoRA,,1,4,4,False,False,True,1536,1024,2560,64,2,32,128,32,100,,,,,,,,NVIDIA A100-SXM4-40GB,40960,maximum externally sampled per-device memory,3,3,0,40631.333333333336,3,0,eligible_resource_outcomes,149Phi-4-mini-instruct,GSM8K mathematics,2,1,c4,16,0.8,memory_failure,3,0,0,,38912,3,cfg-966f5804dc918967,case-abb8a07d13eb7634,boundary,phi4_mini,microsoft/Phi-4-mini-instruct,gsm8k,gsm8k,GRPO,LoRA,,1,4,4,False,False,True,1024,2048,3072,64,2,32,32,32,100,,,,,,,,NVIDIA A100-SXM4-40GB,40960,maximum externally sampled per-device memory,3,0,3,,0,0,eligible_resource_outcomes,150Phi-4-mini-instruct,GSM8K mathematics,2,1,c2,8,0.6,within_margin,3,3,3,35538.0,38912,3,cfg-96ccf395b84393f7,case-abb8a07d13eb7634,boundary,phi4_mini,microsoft/Phi-4-mini-instruct,gsm8k,gsm8k,GRPO,LoRA,,1,4,4,False,False,True,1024,2048,3072,64,2,32,32,32,100,,,,,,,,NVIDIA A100-SXM4-40GB,40960,maximum externally sampled per-device memory,3,0,0,35524.666666666664,3,0,eligible_resource_outcomes,151Phi-4-mini-instruct,Standard code,2,1,c2,8,0.6,within_margin,3,3,3,35958.0,38912,3,cfg-97107ceba8bf0cbe,case-9016781c2a452d34,boundary,phi4_mini,microsoft/Phi-4-mini-instruct,code_standard,code_standard,GRPO,LoRA,,1,4,4,False,False,True,640,1024,1664,64,2,32,32,32,100,,,,,,,,NVIDIA A100-SXM4-40GB,40960,maximum externally sampled per-device memory,3,0,0,35958.0,3,0,eligible_resource_outcomes,152Granite-3.3-2B-Instruct,MATH mathematics,4,1,c2,8,0.6,within_margin,3,3,3,30068.0,38912,3,cfg-9758870c0a0b4d69,case-4b10c2bfe26b9b30,four_gpu,granite33_2b,ibm-granite/granite-3.3-2b-instruct,math,math,GRPO,LoRA,four_gpu,1,8,8,False,False,True,512,512,1024,128,2,64,256,64,100,True,1,-1,-1,False,disable,1,NVIDIA A100-SXM4-40GB,40960,maximum externally sampled per-device memory,3,0,0,30068.0,3,0,eligible_resource_outcomes,153Phi-4-mini-instruct,Standard code,2,1,c0,1,0.3,within_margin,3,3,3,26056.0,38912,3,cfg-9c461415e6bb9702,case-9016781c2a452d34,boundary,phi4_mini,microsoft/Phi-4-mini-instruct,code_standard,code_standard,GRPO,LoRA,,1,4,4,True,False,True,640,1024,1664,64,2,32,32,32,100,,,,,,,,NVIDIA A100-SXM4-40GB,40960,maximum externally sampled per-device memory,3,0,0,26049.333333333332,3,0,eligible_resource_outcomes,154Granite-3.3-2B-Instruct,MATH mathematics,4,1,c4,16,0.8,within_margin,3,3,3,38148.0,38912,3,cfg-9f624ec22aa3dde0,case-4b10c2bfe26b9b30,four_gpu,granite33_2b,ibm-granite/granite-3.3-2b-instruct,math,math,GRPO,LoRA,four_gpu,1,8,8,False,False,True,512,512,1024,128,2,64,256,64,100,True,1,-1,-1,False,disable,1,NVIDIA A100-SXM4-40GB,40960,maximum externally sampled per-device memory,3,0,0,38134.666666666664,3,0,eligible_resource_outcomes,155Phi-4-mini-instruct,Standard code,2,1,c3,16,0.7,above_margin,3,3,0,39990.0,38912,3,cfg-a026693bae37d30b,case-9016781c2a452d34,boundary,phi4_mini,microsoft/Phi-4-mini-instruct,code_standard,code_standard,GRPO,LoRA,,1,4,4,False,False,True,640,1024,1664,64,2,32,32,32,100,,,,,,,,NVIDIA A100-SXM4-40GB,40960,maximum externally sampled per-device memory,3,3,0,39930.666666666664,3,0,eligible_resource_outcomes,156Qwen2.5-3B-Instruct,MATH mathematics,4,1,c4,16,0.8,within_margin,3,3,3,38316.0,38912,3,cfg-a23a9ffc1f670139,case-398e989379a2ea29,four_gpu,qwen25_3b,Qwen/Qwen2.5-3B-Instruct,math,math,GRPO,LoRA,four_gpu,1,8,8,False,False,True,512,512,1024,128,2,64,64,64,100,True,1,-1,-1,False,disable,1,NVIDIA A100-SXM4-40GB,40960,maximum externally sampled per-device memory,3,0,0,38314.666666666664,3,0,eligible_resource_outcomes,157Phi-4-mini-instruct,Longer-prompt code,2,1,c0,1,0.3,within_margin,3,3,3,26076.0,38912,3,cfg-a24e9cdd2f6143f2,case-0cbe32dd0cd7439d,boundary,phi4_mini,microsoft/Phi-4-mini-instruct,longer_prompt_code,code_heavy_tail,GRPO,LoRA,,1,4,4,True,False,True,1536,1024,2560,64,2,32,32,32,100,,,,,,,,NVIDIA A100-SXM4-40GB,40960,maximum externally sampled per-device memory,3,0,0,26062.666666666668,3,0,eligible_resource_outcomes,158Granite-3.3-2B-Instruct,GSM8K mathematics,2,100,interpolated_boundary,16,0.75,within_margin,3,3,3,38586.0,38912,3,cfg-a330fc0dc0b46c34,case-e810629bc3f06bee,horizon_followup,granite33_2b,ibm-granite/granite-3.3-2b-instruct,gsm8k,gsm8k,GRPO,LoRA,long,1,4,4,False,False,True,1024,2048,3072,64,2,32,-1,32,100,True,1,25,20,True,disable,1,NVIDIA A100-SXM4-40GB,40960,maximum externally sampled per-device memory,3,0,0,38554.0,3,0,eligible_resource_outcomes,159Phi-4-mini-instruct,MATH mathematics,2,1,c3,16,0.7,above_margin,3,3,0,40080.0,38912,3,cfg-a3987314cb2f9f12,case-72e234e68dbd93fc,boundary,phi4_mini,microsoft/Phi-4-mini-instruct,math,math,GRPO,LoRA,,1,8,8,False,False,True,512,512,1024,128,2,64,64,64,100,,,,,,,,NVIDIA A100-SXM4-40GB,40960,maximum externally sampled per-device memory,3,3,0,40037.333333333336,3,0,eligible_resource_outcomes,160Granite-3.3-2B-Instruct,Standard code,2,1,c2,8,0.6,within_margin,3,3,3,32534.0,38912,6,cfg-a94bf7877633dfda,case-b2740e83619312c4,boundary,granite33_2b,ibm-granite/granite-3.3-2b-instruct,code_standard,code_standard,GRPO,LoRA,,1,4,4,False,False,True,640,1024,1664,64,2,32,128,32,100,,,,,,,,NVIDIA A100-SXM4-40GB,40960,maximum externally sampled per-device memory,3,0,0,32406.666666666668,3,3,eligible_resource_outcomes,161Granite-3.3-2B-Instruct,Longer-prompt code,2,1,c3,16,0.7,within_margin,3,3,3,36758.0,38912,3,cfg-aa33c72e0a449b9c,case-201b7a50ed47a7dd,boundary,granite33_2b,ibm-granite/granite-3.3-2b-instruct,longer_prompt_code,code_heavy_tail,GRPO,LoRA,,1,4,4,False,False,True,1536,1024,2560,64,2,32,128,32,100,,,,,,,,NVIDIA A100-SXM4-40GB,40960,maximum externally sampled per-device memory,3,0,0,36620.666666666664,3,0,eligible_resource_outcomes,162Granite-3.3-2B-Instruct,Longer-prompt code,2,1,c2,8,0.6,within_margin,3,3,3,32542.0,38912,3,cfg-acfa4acda15c3599,case-201b7a50ed47a7dd,boundary,granite33_2b,ibm-granite/granite-3.3-2b-instruct,longer_prompt_code,code_heavy_tail,GRPO,LoRA,,1,4,4,False,False,True,1536,1024,2560,64,2,32,128,32,100,,,,,,,,NVIDIA A100-SXM4-40GB,40960,maximum externally sampled per-device memory,3,0,0,32538.666666666668,3,0,eligible_resource_outcomes,163Qwen2.5-3B-Instruct,Longer-prompt code,2,1,c0,1,0.3,within_margin,3,3,3,21562.0,38912,3,cfg-b5007322fb2e1772,case-f465ad721b3d7997,boundary,qwen25_3b,Qwen/Qwen2.5-3B-Instruct,longer_prompt_code,code_heavy_tail,GRPO,LoRA,,1,4,4,True,False,True,1536,1024,2560,64,2,32,32,32,100,,,,,,,,NVIDIA A100-SXM4-40GB,40960,maximum externally sampled per-device memory,3,0,0,21548.666666666668,3,0,eligible_resource_outcomes,164Granite-3.3-2B-Instruct,MATH mathematics,2,1,c2,8,0.6,within_margin,3,3,3,32710.0,38912,6,cfg-b5352215babfeba6,case-8a509de3be5cc9c0,boundary,granite33_2b,ibm-granite/granite-3.3-2b-instruct,math,math,GRPO,LoRA,,1,8,8,False,False,True,512,512,1024,128,2,64,256,64,100,,,,,,,,NVIDIA A100-SXM4-40GB,40960,maximum externally sampled per-device memory,3,0,0,32703.333333333332,3,3,eligible_resource_outcomes,165Granite-3.3-2B-Instruct,MATH mathematics,2,1,c0,1,0.3,within_margin,3,3,3,19418.0,38912,6,cfg-b56fb353c2f2fa3e,case-8a509de3be5cc9c0,boundary,granite33_2b,ibm-granite/granite-3.3-2b-instruct,math,math,GRPO,LoRA,,1,8,8,True,False,True,512,512,1024,128,2,64,256,64,100,,,,,,,,NVIDIA A100-SXM4-40GB,40960,maximum externally sampled per-device memory,3,0,0,19418.0,3,3,eligible_resource_outcomes,166Phi-4-mini-instruct,GSM8K mathematics,2,1,c1,4,0.45,within_margin,3,3,3,26054.0,38912,3,cfg-b8dd70ab682c13b2,case-abb8a07d13eb7634,boundary,phi4_mini,microsoft/Phi-4-mini-instruct,gsm8k,gsm8k,GRPO,LoRA,,1,4,4,True,False,True,1024,2048,3072,64,2,32,32,32,100,,,,,,,,NVIDIA A100-SXM4-40GB,40960,maximum externally sampled per-device memory,3,0,0,26054.0,3,0,eligible_resource_outcomes,167Granite-3.3-2B-Instruct,GSM8K mathematics,4,1,c2,8,0.6,within_margin,3,3,3,29660.0,38912,3,cfg-b8e90bd69c9744ea,case-d09edefcf783cd45,four_gpu,granite33_2b,ibm-granite/granite-3.3-2b-instruct,gsm8k,gsm8k,GRPO,LoRA,four_gpu,1,4,4,False,False,True,1024,2048,3072,64,2,32,128,32,100,True,1,-1,-1,False,disable,1,NVIDIA A100-SXM4-40GB,40960,maximum externally sampled per-device memory,3,0,0,29660.0,3,0,eligible_resource_outcomes,168Granite-3.3-2B-Instruct,Standard code,2,1,c0,1,0.3,within_margin,3,3,3,19070.0,38912,5,cfg-bae2977da7957f72,case-b2740e83619312c4,boundary,granite33_2b,ibm-granite/granite-3.3-2b-instruct,code_standard,code_standard,GRPO,LoRA,,1,4,4,True,False,True,640,1024,1664,64,2,32,128,32,100,,,,,,,,NVIDIA A100-SXM4-40GB,40960,maximum externally sampled per-device memory,3,0,0,19063.333333333332,3,2,eligible_resource_outcomes,169Qwen2.5-3B-Instruct,Longer-prompt code,2,1,c1,4,0.45,within_margin,3,3,3,21560.0,38912,3,cfg-bfb83ff32b7fd921,case-f465ad721b3d7997,boundary,qwen25_3b,Qwen/Qwen2.5-3B-Instruct,longer_prompt_code,code_heavy_tail,GRPO,LoRA,,1,4,4,True,False,True,1536,1024,2560,64,2,32,32,32,100,,,,,,,,NVIDIA A100-SXM4-40GB,40960,maximum externally sampled per-device memory,3,0,0,21554.0,3,0,eligible_resource_outcomes,170Phi-4-mini-instruct,GSM8K mathematics,2,1,c3,16,0.7,above_margin,3,3,0,39570.0,38912,3,cfg-c0605c1607caa079,case-abb8a07d13eb7634,boundary,phi4_mini,microsoft/Phi-4-mini-instruct,gsm8k,gsm8k,GRPO,LoRA,,1,4,4,False,False,True,1024,2048,3072,64,2,32,32,32,100,,,,,,,,NVIDIA A100-SXM4-40GB,40960,maximum externally sampled per-device memory,3,3,0,39556.666666666664,3,0,eligible_resource_outcomes,171Granite-3.3-2B-Instruct,GSM8K mathematics,4,1,c3,16,0.7,within_margin,3,3,3,33660.0,38912,3,cfg-c2a8e6e8e140e109,case-d09edefcf783cd45,four_gpu,granite33_2b,ibm-granite/granite-3.3-2b-instruct,gsm8k,gsm8k,GRPO,LoRA,four_gpu,1,4,4,False,False,True,1024,2048,3072,64,2,32,128,32,100,True,1,-1,-1,False,disable,1,NVIDIA A100-SXM4-40GB,40960,maximum externally sampled per-device memory,3,0,0,33660.0,3,0,eligible_resource_outcomes,172Granite-3.3-2B-Instruct,Standard code,2,1,c3,16,0.7,within_margin,3,3,3,36506.0,38912,6,cfg-c3f0ad157d299d39,case-b2740e83619312c4,boundary,granite33_2b,ibm-granite/granite-3.3-2b-instruct,code_standard,code_standard,GRPO,LoRA,,1,4,4,False,False,True,640,1024,1664,64,2,32,128,32,100,,,,,,,,NVIDIA A100-SXM4-40GB,40960,maximum externally sampled per-device memory,3,0,0,36429.333333333336,3,3,eligible_resource_outcomes,173Qwen2.5-3B-Instruct,Standard code,2,1,c5,32,0.85,memory_failure,3,0,0,,38912,3,cfg-ca71b56dc3189305,case-3b29fa0f8aca4ad8,boundary,qwen25_3b,Qwen/Qwen2.5-3B-Instruct,code_standard,code_standard,GRPO,LoRA,,1,4,4,False,False,True,640,1024,1664,64,2,32,32,32,100,,,,,,,,NVIDIA A100-SXM4-40GB,40960,maximum externally sampled per-device memory,3,0,3,,0,0,eligible_resource_outcomes,174Qwen2.5-3B-Instruct,MATH mathematics,2,1,c5,32,0.85,memory_failure,3,0,0,,38912,3,cfg-cad8341dbbff10ba,case-4292ea81ce5a0a8a,boundary,qwen25_3b,Qwen/Qwen2.5-3B-Instruct,math,math,GRPO,LoRA,,1,8,8,False,False,True,512,512,1024,128,2,64,64,64,100,,,,,,,,NVIDIA A100-SXM4-40GB,40960,maximum externally sampled per-device memory,3,0,3,,0,0,eligible_resource_outcomes,175Phi-4-mini-instruct,GSM8K mathematics,2,100,interpolated_boundary,16,0.65,within_margin,3,3,3,37716.0,38912,3,cfg-cadb236b55d403e1,case-8700b31b74e17678,horizon_followup,phi4_mini,microsoft/Phi-4-mini-instruct,gsm8k,gsm8k,GRPO,LoRA,long,1,4,4,False,False,True,1024,2048,3072,64,2,32,-1,32,100,True,1,25,20,True,disable,1,NVIDIA A100-SXM4-40GB,40960,maximum externally sampled per-device memory,3,0,0,37688.0,3,0,eligible_resource_outcomes,176Granite-3.3-2B-Instruct,GSM8K mathematics,2,1,interpolated_boundary,16,0.75,within_margin,3,3,3,38422.0,38912,3,cfg-cc030db9324662ea,case-7b743f1fb1e8d712,horizon_followup,granite33_2b,ibm-granite/granite-3.3-2b-instruct,gsm8k,gsm8k,GRPO,LoRA,source,1,4,4,False,False,True,1024,2048,3072,64,2,32,-1,32,100,True,1,25,20,True,disable,1,NVIDIA A100-SXM4-40GB,40960,maximum externally sampled per-device memory,3,0,0,38418.666666666664,3,0,eligible_resource_outcomes,177Qwen2.5-3B-Instruct,GSM8K mathematics,4,1,c3,16,0.7,within_margin,3,3,3,33872.0,38912,3,cfg-cc2c35944156e5d4,case-51d35057c79e5d8c,four_gpu,qwen25_3b,Qwen/Qwen2.5-3B-Instruct,gsm8k,gsm8k,GRPO,LoRA,four_gpu,1,4,4,False,False,True,1024,2048,3072,64,2,32,32,32,100,True,1,-1,-1,False,disable,1,NVIDIA A100-SXM4-40GB,40960,maximum externally sampled per-device memory,3,0,0,33865.333333333336,3,0,eligible_resource_outcomes,178Granite-3.3-2B-Instruct,Standard code,2,1,c1,4,0.45,within_margin,3,3,3,21298.0,38912,6,cfg-cc5f4f0c2e1256ba,case-b2740e83619312c4,boundary,granite33_2b,ibm-granite/granite-3.3-2b-instruct,code_standard,code_standard,GRPO,LoRA,,1,4,4,True,False,True,640,1024,1664,64,2,32,128,32,100,,,,,,,,NVIDIA A100-SXM4-40GB,40960,maximum externally sampled per-device memory,3,0,0,21286.0,3,3,eligible_resource_outcomes,179Phi-4-mini-instruct,MATH mathematics,2,1,c5,32,0.85,memory_failure,3,0,0,,38912,3,cfg-cc900fb7731c3f49,case-72e234e68dbd93fc,boundary,phi4_mini,microsoft/Phi-4-mini-instruct,math,math,GRPO,LoRA,,1,8,8,False,False,True,512,512,1024,128,2,64,64,64,100,,,,,,,,NVIDIA A100-SXM4-40GB,40960,maximum externally sampled per-device memory,3,0,3,,0,0,eligible_resource_outcomes,180Qwen2.5-3B-Instruct,GSM8K mathematics,2,1,c1,4,0.45,within_margin,3,3,3,21580.0,38912,3,cfg-cd3974595f9db882,case-63523914ab4f2ca0,boundary,qwen25_3b,Qwen/Qwen2.5-3B-Instruct,gsm8k,gsm8k,GRPO,LoRA,,1,4,4,True,False,True,1024,2048,3072,64,2,32,32,32,100,,,,,,,,NVIDIA A100-SXM4-40GB,40960,maximum externally sampled per-device memory,3,0,0,21566.666666666668,3,0,eligible_resource_outcomes,181Granite-3.3-2B-Instruct,MATH mathematics,2,1,c4,16,0.8,above_margin,3,3,0,40750.0,38912,7,cfg-d02503f8c9804a2d,case-8a509de3be5cc9c0,boundary,granite33_2b,ibm-granite/granite-3.3-2b-instruct,math,math,GRPO,LoRA,,1,8,8,False,False,True,512,512,1024,128,2,64,256,64,100,,,,,,,,NVIDIA A100-SXM4-40GB,40960,maximum externally sampled per-device memory,3,3,0,40750.0,3,4,eligible_resource_outcomes,182Phi-4-mini-instruct,MATH mathematics,2,1,c4,16,0.8,memory_failure,3,0,0,,38912,3,cfg-d138048feeb8fe5d,case-72e234e68dbd93fc,boundary,phi4_mini,microsoft/Phi-4-mini-instruct,math,math,GRPO,LoRA,,1,8,8,False,False,True,512,512,1024,128,2,64,64,64,100,,,,,,,,NVIDIA A100-SXM4-40GB,40960,maximum externally sampled per-device memory,3,0,3,,0,0,eligible_resource_outcomes,183Granite-3.3-2B-Instruct,GSM8K mathematics,2,1,c1,4,0.45,within_margin,3,3,3,21128.0,38912,3,cfg-d4a213515805a9a7,case-ab5bfd69a29741ce,boundary,granite33_2b,ibm-granite/granite-3.3-2b-instruct,gsm8k,gsm8k,GRPO,LoRA,,1,4,4,True,False,True,1024,2048,3072,64,2,32,128,32,100,,,,,,,,NVIDIA A100-SXM4-40GB,40960,maximum externally sampled per-device memory,3,0,0,21121.333333333332,3,0,eligible_resource_outcomes,184Granite-3.3-2B-Instruct,Longer-prompt code,2,1,c1,4,0.45,within_margin,3,3,3,21302.0,38912,3,cfg-d9397d15f234d541,case-201b7a50ed47a7dd,boundary,granite33_2b,ibm-granite/granite-3.3-2b-instruct,longer_prompt_code,code_heavy_tail,GRPO,LoRA,,1,4,4,True,False,True,1536,1024,2560,64,2,32,128,32,100,,,,,,,,NVIDIA A100-SXM4-40GB,40960,maximum externally sampled per-device memory,3,0,0,21272.0,3,0,eligible_resource_outcomes,185Qwen2.5-3B-Instruct,Standard code,2,1,c1,4,0.45,within_margin,3,3,3,21540.0,38912,3,cfg-db87c67536995ab0,case-3b29fa0f8aca4ad8,boundary,qwen25_3b,Qwen/Qwen2.5-3B-Instruct,code_standard,code_standard,GRPO,LoRA,,1,4,4,True,False,True,640,1024,1664,64,2,32,32,32,100,,,,,,,,NVIDIA A100-SXM4-40GB,40960,maximum externally sampled per-device memory,3,0,0,21540.0,3,0,eligible_resource_outcomes,186Phi-4-mini-instruct,Longer-prompt code,2,1,c2,8,0.6,within_margin,3,3,3,36100.0,38912,3,cfg-e117f15dd5ccfb30,case-0cbe32dd0cd7439d,boundary,phi4_mini,microsoft/Phi-4-mini-instruct,longer_prompt_code,code_heavy_tail,GRPO,LoRA,,1,4,4,False,False,True,1536,1024,2560,64,2,32,32,32,100,,,,,,,,NVIDIA A100-SXM4-40GB,40960,maximum externally sampled per-device memory,3,0,0,36030.0,3,0,eligible_resource_outcomes,187Phi-4-mini-instruct,MATH mathematics,2,1,c0,1,0.3,within_margin,3,3,3,26348.0,38912,3,cfg-e2a205be8efba055,case-72e234e68dbd93fc,boundary,phi4_mini,microsoft/Phi-4-mini-instruct,math,math,GRPO,LoRA,,1,8,8,True,False,True,512,512,1024,128,2,64,64,64,100,,,,,,,,NVIDIA A100-SXM4-40GB,40960,maximum externally sampled per-device memory,3,0,0,26341.333333333332,3,0,eligible_resource_outcomes,188Granite-3.3-2B-Instruct,GSM8K mathematics,2,1,c5,32,0.85,memory_failure,3,0,0,,38912,4,cfg-e8893b12558f51dd,case-ab5bfd69a29741ce,boundary,granite33_2b,ibm-granite/granite-3.3-2b-instruct,gsm8k,gsm8k,GRPO,LoRA,,1,4,4,False,False,True,1024,2048,3072,64,2,32,128,32,100,,,,,,,,NVIDIA A100-SXM4-40GB,40960,maximum externally sampled per-device memory,3,0,3,,0,1,eligible_resource_outcomes,189Qwen2.5-3B-Instruct,Longer-prompt code,2,1,c2,8,0.6,within_margin,3,3,3,33436.0,38912,3,cfg-e91942abb5b4f847,case-f465ad721b3d7997,boundary,qwen25_3b,Qwen/Qwen2.5-3B-Instruct,longer_prompt_code,code_heavy_tail,GRPO,LoRA,,1,4,4,False,False,True,1536,1024,2560,64,2,32,32,32,100,,,,,,,,NVIDIA A100-SXM4-40GB,40960,maximum externally sampled per-device memory,3,0,0,33381.333333333336,3,0,eligible_resource_outcomes,190Qwen2.5-3B-Instruct,Standard code,2,1,c4,16,0.8,memory_failure,3,0,0,,38912,4,cfg-ea5a23a40ad5ca50,case-3b29fa0f8aca4ad8,boundary,qwen25_3b,Qwen/Qwen2.5-3B-Instruct,code_standard,code_standard,GRPO,LoRA,,1,4,4,False,False,True,640,1024,1664,64,2,32,32,32,100,,,,,,,,NVIDIA A100-SXM4-40GB,40960,maximum externally sampled per-device memory,3,0,3,,0,1,eligible_resource_outcomes,191Phi-4-mini-instruct,Standard code,2,1,c4,16,0.8,memory_failure,3,0,0,,38912,3,cfg-ea92cccc91029465,case-9016781c2a452d34,boundary,phi4_mini,microsoft/Phi-4-mini-instruct,code_standard,code_standard,GRPO,LoRA,,1,4,4,False,False,True,640,1024,1664,64,2,32,32,32,100,,,,,,,,NVIDIA A100-SXM4-40GB,40960,maximum externally sampled per-device memory,3,0,3,,0,0,eligible_resource_outcomes,192Qwen2.5-3B-Instruct,MATH mathematics,2,1,c3,16,0.7,within_margin,3,3,3,37478.0,38912,3,cfg-f009e9e3891c06f4,case-4292ea81ce5a0a8a,boundary,qwen25_3b,Qwen/Qwen2.5-3B-Instruct,math,math,GRPO,LoRA,,1,8,8,False,False,True,512,512,1024,128,2,64,64,64,100,,,,,,,,NVIDIA A100-SXM4-40GB,40960,maximum externally sampled per-device memory,3,0,0,37478.0,3,0,eligible_resource_outcomes,193Qwen2.5-3B-Instruct,MATH mathematics,4,1,c2,8,0.6,within_margin,3,3,3,30180.0,38912,3,cfg-f03e4e98c682240e,case-398e989379a2ea29,four_gpu,qwen25_3b,Qwen/Qwen2.5-3B-Instruct,math,math,GRPO,LoRA,four_gpu,1,8,8,False,False,True,512,512,1024,128,2,64,64,64,100,True,1,-1,-1,False,disable,1,NVIDIA A100-SXM4-40GB,40960,maximum externally sampled per-device memory,3,0,0,30178.666666666668,3,0,eligible_resource_outcomes,194Granite-3.3-2B-Instruct,GSM8K mathematics,4,1,c4,16,0.8,within_margin,3,3,3,37740.0,38912,3,cfg-f439d2dd90137a80,case-d09edefcf783cd45,four_gpu,granite33_2b,ibm-granite/granite-3.3-2b-instruct,gsm8k,gsm8k,GRPO,LoRA,four_gpu,1,4,4,False,False,True,1024,2048,3072,64,2,32,128,32,100,True,1,-1,-1,False,disable,1,NVIDIA A100-SXM4-40GB,40960,maximum externally sampled per-device memory,3,0,0,37740.0,3,0,eligible_resource_outcomes,195Phi-4-mini-instruct,Standard code,2,1,c1,4,0.45,within_margin,3,3,3,26056.0,38912,3,cfg-f75b68f479767290,case-9016781c2a452d34,boundary,phi4_mini,microsoft/Phi-4-mini-instruct,code_standard,code_standard,GRPO,LoRA,,1,4,4,True,False,True,640,1024,1664,64,2,32,32,32,100,,,,,,,,NVIDIA A100-SXM4-40GB,40960,maximum externally sampled per-device memory,3,0,0,26042.666666666668,3,0,eligible_resource_outcomes,196Qwen2.5-3B-Instruct,Longer-prompt code,2,1,c5,32,0.85,memory_failure,3,0,0,,38912,3,cfg-fad1b555f8b37235,case-f465ad721b3d7997,boundary,qwen25_3b,Qwen/Qwen2.5-3B-Instruct,longer_prompt_code,code_heavy_tail,GRPO,LoRA,,1,4,4,False,False,True,1536,1024,2560,64,2,32,32,32,100,,,,,,,,NVIDIA A100-SXM4-40GB,40960,maximum externally sampled per-device memory,3,0,3,,0,0,eligible_resource_outcomes,197Granite-3.3-2B-Instruct,GSM8K mathematics,2,1,c2,8,0.6,within_margin,3,3,3,32302.0,38912,3,cfg-fbe1c0422f98cb38,case-ab5bfd69a29741ce,boundary,granite33_2b,ibm-granite/granite-3.3-2b-instruct,gsm8k,gsm8k,GRPO,LoRA,,1,4,4,False,False,True,1024,2048,3072,64,2,32,128,32,100,,,,,,,,NVIDIA A100-SXM4-40GB,40960,maximum externally sampled per-device memory,3,0,0,32302.0,3,0,eligible_resource_outcomes,198Granite-3.3-2B-Instruct,MATH mathematics,2,1,c1,4,0.45,within_margin,3,3,3,21516.0,38912,6,cfg-fd4d4789145230df,case-8a509de3be5cc9c0,boundary,granite33_2b,ibm-granite/granite-3.3-2b-instruct,math,math,GRPO,LoRA,,1,8,8,True,False,True,512,512,1024,128,2,64,256,64,100,,,,,,,,NVIDIA A100-SXM4-40GB,40960,maximum externally sampled per-device memory,3,0,0,21516.0,3,3,eligible_resource_outcomes,199Granite-3.3-2B-Instruct,GSM8K mathematics,2,1,c0,1,0.3,within_margin,3,3,3,19050.0,38912,3,cfg-fd5bb0db68b0dae3,case-ab5bfd69a29741ce,boundary,granite33_2b,ibm-granite/granite-3.3-2b-instruct,gsm8k,gsm8k,GRPO,LoRA,,1,4,4,True,False,True,1024,2048,3072,64,2,32,128,32,100,,,,,,,,NVIDIA A100-SXM4-40GB,40960,maximum externally sampled per-device memory,3,0,0,19036.666666666668,3,0,eligible_resource_outcomes,1100