LLM-course/ParetoTinyRNNTransformers240k_v4_ramp_TRM_d72_L4_H4_C8_250k_LegalW0p5_ckpt18000

Chess model submitted to the LLM Course Chess Challenge.

Submission Info

• —Submitted by: janisaiad
• —Parameters: 240,048
• —Organization: LLM-course

Model Details

• —Architecture: Tiny Recursive Model (TRM) - looping recurrent transformer (cycle-shared weights)
• —Vocab size: 148
• —Embedding dim: 72
• —Layers: 4
• —Heads: 4
• —Cycles: 8

TRM note: this is a looping TRM model — at inference/training time we run the same transformer stack for 8 recurrent refinement cycle(s) (weights are shared across cycles), which increases compute/reasoning depth without increasing parameter count.