CoolFace
Modelpublic

TokenBender/glm47-flash-pie-cpp-lora-r16-sft-h100

sourceHugging Facemitupdated 2mo agoView on Hugging Face
1likes4downloads
Model Card

GLM-4.7-Flash PIE C++ SFT LoRA

LoRA rank-16 supervised fine-tuning adapter for `zai-org/GLM-4.7-Flash`, trained on the PIE C++ performance task.

Result

The full 1,259-task evaluation produced:

MetricResult
Pass rate90.79%
Valid format rate97.70%
Correct and faster rate28.36%
Mean speedup when correct and faster1.43x
Mean reward0.8980
Timeout rate0.00%

The complete per-task records and generated responses are under evidence/eval/.

Training Profile

SettingValue
Accelerators8x NVIDIA H100
ParallelismTP4 / PP1 / EP8
Sequence length4,096
Max tokens per GPU24,576
Global batch size32
LoRA rank / alpha16 / 32
Peak allocated memory36,039 MiB per GPU
CheckpointStep 244

Files

  • adapter_model.bin and adapter_config.json: loadable PEFT adapter.
  • adapter_megatron_tp*_pp0.pt: four Megatron tensor-parallel shards.
  • training_state_rank*.pt: per-rank training state.
  • evidence/training/: run receipt and VRAM trace.
  • evidence/eval/: complete evaluation summaries, records, and generations.

Loading

python
from peft import PeftModel
from transformers import AutoModelForCausalLM

base = AutoModelForCausalLM.from_pretrained(
    "zai-org/GLM-4.7-Flash",
    trust_remote_code=True,
)
model = PeftModel.from_pretrained(
    base,
    "TokenBender/glm47-flash-pie-cpp-lora-r16-sft-h100",
)

Training code: TokenBender/browser-is-all-you-need