AI4SGI/ExoMind-Q8_0-GGUF

<div align="center">

<img src="./assets/ExoMind.png" alt="ExoMind" width="560">

ExoMind: Democratizing Scientific Intelligence via Extended-Mind-Inspired Agentic System

ExoMind Team · Shanghai Artificial Intelligence Laboratory

<p> <a href="https://ai4sgi.github.io/ExoMind/"><img src="https://img.shields.io/badge/ProjectPage-Visit-174F87?style=for-the-badge&logo=googlechrome&logoColor=white" alt="Project Page"></a> <a href="https://doi.org/10.20944/preprints202608.2038.v1"><img src="https://img.shields.io/badge/Paper-Preprint-B31B1B?style=for-the-badge&logo=adobeacrobatreader&logoColor=white" alt="ExoMind preprint"></a> </p> <p> <a href="https://huggingface.co/AI4SGI/ExoMind-Q80-GGUF"><img src="https://img.shields.io/badge/HuggingFace-Model-FFD21E?style=for-the-badge&logo=huggingface&logoColor=000000" alt="Hugging Face"></a> <a href="https://github.com/AI4SGI/ExoMind"><img src="https://img.shields.io/badge/GitHub-Code-181717?style=for-the-badge&logo=github&logoColor=white" alt="GitHub"></a> <a href="https://modelscope.cn/models/AI4SGI/ExoMind-Q80-GGUF"><img src="https://img.shields.io/badge/ModelScope-Model-624AFF?style=for-the-badge" alt="ModelScope"></a> </p>

</div>

Overview

Q8_0 GGUF release of ExoMind, providing a higher-fidelity local-inference option.

This repository intentionally contains only the Q8_0 model and the matching multimodal projector. Keeping each precision in its own repository makes downloads, local disk requirements, and deployment commands explicit.

Files

Quick Start with llama.cpp

Text-only serving:

llama-server \
  -m qwen3_5_35b_a3b-Q8_0.gguf \
  --ctx-size 32768 \
  --host 0.0.0.0 \
  --port 8080

For image input, load the projector shipped in this repository:

llama-server \
  -m qwen3_5_35b_a3b-Q8_0.gguf \
  --mmproj mmproj-qwen3_5_35b_a3b-F16.gguf \
  --ctx-size 32768 \
  --host 0.0.0.0 \
  --port 8080

Conversion Provenance

These GGUF files were supplied as existing release artifacts. Their exact filenames, byte sizes, and GGUF v3 headers were validated before publication, but the original HF-to-GGUF conversion and quantization commands were not retained with the files. The repository therefore does not claim bit-for-bit reproducibility of the original conversion pipeline.

Evaluation Boundary

Published benchmark results use the original ExoMind 35B-A3B BF16 checkpoint. This Q8_0 conversion has not been assigned separate scores.

Complete settings and comparisons are available in the evaluation explorer.

License and Attribution

The model files and upstream Qwen3.5 materials are distributed under the Apache License 2.0 included with the model. Preprint text, scientific figures, results, and ExoMind brand assets are governed by the ExoMind Research Content and Brand Terms. See NOTICE.md for third-party notices.

Citation

@article{Ye_2026,
  title     = {ExoMind: Democratizing Scientific Intelligence via Extended-Mind-Inspired Agentic System},
  author    = {Ye, Peng and Liu, Zhuo and Ye, Jingqi and Yu, Fangchen and Tang, Shengji and Jiang, Yichen and He, Haonan and Cao, Zongsheng and Chen, Tao and Zhang, Bo and Ouyang, Wanli and Zhou, Bowen and Bai, Lei},
  year      = {2026},
  month     = aug,
  publisher = {MDPI AG},
  doi       = {10.20944/preprints202608.2038.v1},
  url       = {https://doi.org/10.20944/preprints202608.2038.v1}
}