Abiray/Sutra-Instruct-v2-350M

🚀 Sutra-Instruct-v2-350M

Sutra-Instruct-v2-350M is a highly optimized, 350-million parameter language model built for developers and researchers. It has undergone rigorous Continuous Pre-Training (CPT) to dramatically improve its logical reasoning, mathematical deduction, and Python coding capabilities.

Despite its lightweight footprint, Sutra-Instruct-v2 acts as a highly capable "Witty Coder" and educational assistant, punching well above its weight class thanks to a carefully curated, high-IQ dataset recipe.

🧠 Model Details

• —Architecture: 350M Parameter Custom Transformer (GPT-style)
• —Format: Safetensors (Blazing fast, zero-copy loading)
• —Primary Focus: Python Code Generation, Mathematical Reasoning, Educational QA.
• —Developer: Abhiray / Jay

📚 Training Data Recipe (Continuous Pre-Training)

To transition the model from a general-purpose base to a reasoning and bit of coding , we executed a Continuous Pre-Training phase using approximately 3.3 Billion high-quality tokens.

The dataset mixture was meticulously balanced to prevent overfitting while maximizing logical deduction:

🛠️ Intended Use Cases

• —Lightweight Code Copilot: Generating Python scripts, debugging syntax, and writing algorithms locally on low-VRAM hardware.
• —Edge Devices: Perfect for deployment on Raspberry Pi, older laptops, or mobile devices where massive LLMs cannot run.
• —Educational QA: Answering STEM, logic, and general knowledge questions.