yacdev/SomaliLM-150M-Instruct

🇸🇴 SomaliLM-150M-Instruct (100K SFT)

SomaliLM-150M-Instruct is a lightweight, fluent Somali conversational language model fine-tuned on 100,000 pristine multi-turn native Somali conversations across 20 real-world domains.

📊 Specifications:

• —Parameters: ~150 Million
• —Training Dataset: 100,000 native Somali dialogues (579,556 dialogue turns, 17.5M words)
• —Format: ChatML (<|im_start|>user / assistant<|im_end|>)
• —Loss Strategy: Assistant Token Masking (100% loss computed on assistant responses)

💬 Prompt Format (ChatML):

<|im_start|>user
Assalaamu calaykum walaal, sideen ku bilaabaa barashada Python-ka?
<|im_end|>
<|im_start|>assistant