CoolFace
Modelpublic

code2lora/code2lora-gru

sourceHugging Facemitupdated 4mo agoView on Hugging Face
9likes
Model Card

Code2LoRA-GRU — streaming hypernetwork

Final checkpoint of the streaming Code2LoRA-GRU used in the paper. A 1-layer GRU rolls the recurrence over per-commit diff embeddings and emits a rank-16 LoRA adapter for Qwen/Qwen2.5-Coder-1.5B at O(1) per commit.

Files

FileDescription
code2lora_gru.ptTrained GRU + Code2LoRAHead weights (~2.85 GB, fp32).
metrics.jsonlPer-step training metrics (loss, val EM/EditSim/CodeBLEU).

Training recipe

  • —3 epochs of truncated BPTT (window K=16) on code2lora/code2lora-data-smartcap (train QnAs) plus code2lora/code2lora-data-commits (commit metadata + diff embeddings).
  • —AdamW + cosine schedule, max-seq-len 8192, bf16, single H100 80 GB.

Companion model

code2lora/code2lora-direct -- the static-snapshot variant.