AI4SGI/ExoMind-9B-F16-GGUF

<div align="center">

<img src="./assets/ExoMind.png" alt="ExoMind" width="560">

ExoMind: Democratizing Scientific Intelligence via Extended-Mind-Inspired Agentic System

ExoMind Team · Shanghai Artificial Intelligence Laboratory

<p> <a href="https://ai4sgi.github.io/ExoMind/"><img src="https://img.shields.io/badge/ProjectPage-Visit-174F87?style=for-the-badge&logo=googlechrome&logoColor=white" alt="Project Page"></a> <a href="https://doi.org/10.20944/preprints202608.2038.v1"><img src="https://img.shields.io/badge/Paper-Preprint-B31B1B?style=for-the-badge&logo=adobeacrobatreader&logoColor=white" alt="ExoMind preprint"></a> </p> <p> <a href="https://huggingface.co/AI4SGI/ExoMind-9B-F16-GGUF"><img src="https://img.shields.io/badge/HuggingFace-Model-FFD21E?style=for-the-badge&logo=huggingface&logoColor=000000" alt="Hugging Face"></a> <a href="https://github.com/AI4SGI/ExoMind"><img src="https://img.shields.io/badge/GitHub-Code-181717?style=for-the-badge&logo=github&logoColor=white" alt="GitHub"></a> <a href="https://modelscope.cn/models/AI4SGI/ExoMind-9B-F16-GGUF"><img src="https://img.shields.io/badge/ModelScope-Model-624AFF?style=for-the-badge" alt="ModelScope"></a> </p>

</div>

Overview

Reference-precision GGUF release of ExoMind-9B for local inference and downstream GGUF conversion.

This repository intentionally contains only the F16 model and the matching multimodal projector. Keeping each precision in its own repository makes downloads, local disk requirements, and deployment commands explicit.

Files

Quick Start with llama.cpp

Text-only serving:

llama-server \
  -m qwen3_5_9b-F16.gguf \
  --ctx-size 32768 \
  --host 0.0.0.0 \
  --port 8080

For image input, load the projector shipped in this repository:

llama-server \
  -m qwen3_5_9b-F16.gguf \
  --mmproj mmproj-qwen3_5_9b-F16.gguf \
  --ctx-size 32768 \
  --host 0.0.0.0 \
  --port 8080

Conversion Provenance

These GGUF files were supplied as existing release artifacts. Their exact filenames, byte sizes, and GGUF v3 headers were validated before publication, but the original HF-to-GGUF conversion and quantization commands were not retained with the files. The repository therefore does not claim bit-for-bit reproducibility of the original conversion pipeline.

Evaluation Boundary

The main ExoMind benchmark table reports the 35B-A3B system and must not be attributed to ExoMind-9B. This F16 GGUF has no separate scores.

Complete settings and comparisons are available in the evaluation explorer.

License and Attribution

The model files and upstream Qwen3.5 materials are distributed under the Apache License 2.0 included with the model. Preprint text, scientific figures, results, and ExoMind brand assets are governed by the ExoMind Research Content and Brand Terms. See NOTICE.md for third-party notices.

Citation

@article{Ye_2026,
  title     = {ExoMind: Democratizing Scientific Intelligence via Extended-Mind-Inspired Agentic System},
  author    = {Ye, Peng and Liu, Zhuo and Ye, Jingqi and Yu, Fangchen and Tang, Shengji and Jiang, Yichen and He, Haonan and Cao, Zongsheng and Chen, Tao and Zhang, Bo and Ouyang, Wanli and Zhou, Bowen and Bai, Lei},
  year      = {2026},
  month     = aug,
  publisher = {MDPI AG},
  doi       = {10.20944/preprints202608.2038.v1},
  url       = {https://doi.org/10.20944/preprints202608.2038.v1}
}