MWirelabs/ne-speechembed

NE-SpeechEmbed

First speech-text retrieval model for Northeast Indian languages.

Architecture

• —Speech encoder: Whisper-medium (fine-tuned on NE-ASR, checkpoint-8000)
• —Text encoder: xlm-roberta-base
• —Projection: Linear(1024→768) speech, Linear(768→768) text
• —Loss: InfoNCE with learned temperature
• —Embed dim: 768 (L2 normalized)

Languages

Khasi, Garo, Mizo, Nagamese, Kokborok, Assamese, Wancho, Chakma

Retrieval Results (100-sample pool)

Training Data

73,476 speech-text pairs from proprietary MWire corpora and Vaani.

Citation

If you use this model, please cite:

@inproceedings{nyalang2026nemultispeech,
title={{NE}-MultiSpeech: A Multilingual Speech Corpus and {ASR} Benchmark for Northeast Indian Languages},
author={Nyalang, Badal and Borah, Angana},
booktitle={The 2026 Conference on Empirical Methods in Natural Language Processing},
year={2026},
url={https://openreview.net/forum?id=cOCsA88Fza}
}

License

CC-BY-4.0 — MWire Labs