alamios/Qwenstral-Small-3.1-0.5B

Qwenstral-Small-3.1-0.5B

Qwen/Qwen2.5-0.5B, but with the vocab of mistralai/Mistral-Small-3.1-24B-Instruct-2503 / mistralai/Mistral-Small-24B-Instruct-2501 transplanted using transplant-vocab.

It can be used as draft model for Mistral-Small directly, but there is a more performant variant finetuned on Mistral's outputs:

• —alamios/Mistral-Small-3.1-DRAFT-0.5B
• —alamios/Mistral-Small-3.1-DRAFT-0.5B-GGUF