CoolFace
Modelpublic

Noushad999/Polymath-1.5B-Bengali-Math

sourceHugging Faceapache-2.0updated 10mo agoView on Hugging Face
0likes10downloads
Model Card

๐Ÿ‡ง๐Ÿ‡ฉ Polymath-1.5B-Bengali-Math

This model is a merge of Qwen/Qwen2.5-1.5B and Qwen/Qwen2.5-1.5B-Instruct created using the SLERP method.

๐Ÿงช Research Goal

To investigate the "Capacity Gap" in low-resource languages (like Bengali) when transferring mathematical reasoning capabilities without fine-tuning.

๐Ÿ“Š Performance

  • โ€”English Math Logic: 60% Accuracy (Retained Logic) โœ…
  • โ€”Bengali Math Logic: 0% Accuracy (Capacity Constraint Revealed) โš ๏ธ

๐Ÿ› ๏ธ Method

Merged using MergeKit with the following config:

  • โ€”Method: SLERP
  • โ€”Precision: float16
  • โ€”Parameters: 1.5 Billion

Created for research and educational purposes.