CoolFace
Modelpublic

AlphaExaAI/ExaMind

sourceHugging Faceapache-2.0updated 7mo agoView on Hugging Face
1likes30downloads
Model Card

<div align="center">

🧠 ExaMind

Advanced Open-Source AI by AlphaExaAI

![License](https://opensource.org/licenses/Apache-2.0) ![Model](https://huggingface.co/AlphaExaAI/ExaMind) ![GitHub](https://github.com/hleliofficiel/AlphaExaAI) ![Architecture](https://huggingface.co/Qwen)

ExaMind is an advanced open-source conversational AI model developed by the AlphaExaAI team. Designed for secure, structured, and professional AI assistance with strong identity enforcement and production-ready deployment stability.

πŸš€ Get Started Β· πŸ“Š Benchmarks Β· 🀝 Contributing Β· πŸ“„ License

</div>


πŸ“Œ Model Overview

PropertyDetails
Model NameExaMind
VersionV2-Final
DeveloperAlphaExaAI
Base ArchitectureQwen2.5-Coder-7B
Parameters7.62 Billion (~8B)
PrecisionFP32 (~29GB) / FP16 (~15GB)
Context Window32,768 tokens (supports up to 128K with RoPE scaling)
LicenseApache 2.0
LanguagesMultilingual (English preferred)
Deploymentβœ… CPU & GPU compatible

✨ Key Capabilities

  • β€”πŸ–₯️ Advanced Programming β€” Code generation, debugging, architecture design, and code review
  • β€”πŸ§© Complex Problem Solving β€” Multi-step logical reasoning and deep technical analysis
  • β€”πŸ”’ Security-First Design β€” Built-in prompt injection resistance and identity enforcement
  • β€”πŸŒ Multilingual β€” Supports all major world languages, optimized for English
  • β€”πŸ’¬ Conversational AI β€” Natural, structured, and professional dialogue
  • β€”πŸ—οΈ Scalable Architecture β€” Secure software engineering and system design guidance
  • β€”βš‘ CPU Deployable β€” Runs on CPU nodes without GPU requirement

πŸ“Š Benchmarks

General Knowledge & Reasoning

BenchmarkSettingScore
MMLU – World Religions0-shot94.8%
MMLU – Overall5-shot72.1%
ARC-Challenge25-shot68.4%
HellaSwag10-shot78.9%
TruthfulQA0-shot61.2%
Winogrande5-shot74.5%

Code Generation

BenchmarkSettingScore
HumanEvalpass@179.3%
MBPPpass@171.8%
MultiPL-E (Python)pass@176.5%
DS-1000pass@148.2%

Math & Reasoning

BenchmarkSettingScore
GSM8K8-shot CoT82.4%
MATH4-shot45.7%

πŸ” Prompt Injection Resistance

TestDetails
Test Set Size50 adversarial prompts
Attack TypeInstruction override / identity manipulation
Resistance Rate92%
MethodCustom red-teaming with jailbreak & override attempts
Evaluation performed using lm-eval-harness on CPU. Security tests performed using custom adversarial prompt suite.

πŸš€ Quick Start

Installation

bash
pip install transformers torch accelerate

Basic Usage

python
from transformers import AutoTokenizer, AutoModelForCausalLM
import torch

model_path = "AlphaExaAI/ExaMind"

tokenizer = AutoTokenizer.from_pretrained(model_path)
model = AutoModelForCausalLM.from_pretrained(
    model_path,
    torch_dtype=torch.float16,
    device_map="auto"
)

messages = [
    {"role": "user", "content": "Explain how to secure a REST API."}
]

inputs = tokenizer.apply_chat_template(
    messages,
    return_tensors="pt",
    add_generation_prompt=True
).to(model.device)

outputs = model.generate(
    inputs,
    max_new_tokens=512,
    temperature=0.7,
    top_p=0.8,
    top_k=20,
    repetition_penalty=1.1
)

response = tokenizer.decode(
    outputs[0][inputs.shape[-1]:],
    skip_special_tokens=True
)
print(response)

CPU Deployment

python
model = AutoModelForCausalLM.from_pretrained(
    "AlphaExaAI/ExaMind",
    torch_dtype=torch.float32,
    device_map="cpu"
)

Using with llama.cpp (GGUF β€” Coming Soon)

bash
# GGUF quantized versions will be released for efficient CPU inference
# Stay tuned for Q4_K_M, Q5_K_M, and Q8_0 variants

πŸ—οΈ Architecture

ExaMind-V2-Final
β”œβ”€β”€ Architecture: Qwen2ForCausalLM (Transformer)
β”œβ”€β”€ Hidden Size: 3,584
β”œβ”€β”€ Intermediate Size: 18,944
β”œβ”€β”€ Layers: 28
β”œβ”€β”€ Attention Heads: 28
β”œβ”€β”€ KV Heads: 4 (GQA)
β”œβ”€β”€ Vocab Size: 152,064
β”œβ”€β”€ Max Position: 32,768 (extendable to 128K)
β”œβ”€β”€ Activation: SiLU
β”œβ”€β”€ RoPE ΞΈ: 1,000,000
└── Precision: FP32 / FP16 compatible

πŸ› οΈ Training Methodology

ExaMind was developed using a multi-stage training pipeline:

StageMethodDescription
Stage 1Base Model SelectionQwen2.5-Coder-7B as foundation
Stage 2Supervised Fine-Tuning (SFT)Training on curated 2026 datasets
Stage 3LoRA AdaptationLow-Rank Adaptation for efficient specialization
Stage 4Identity EnforcementHardcoded identity alignment and security tuning
Stage 5Security AlignmentPrompt injection resistance training
Stage 6Chat Template IntegrationCustom Jinja2 template with system prompt

πŸ“š Training Data

Public Data Sources

  • β€”Programming and code corpora (GitHub, StackOverflow)
  • β€”General web text and knowledge bases
  • β€”Technical documentation and research papers
  • β€”Multilingual text data

Custom Alignment Data

  • β€”Identity enforcement instruction dataset
  • β€”Security-focused instruction tuning samples
  • β€”Prompt injection resistance adversarial examples
  • β€”Structured conversational datasets
  • β€”Complex problem-solving chains
⚠️ No private user data was used in training. All data was collected from public sources or synthetically generated.

πŸ”’ Security Features

ExaMind includes built-in security measures:

  • β€”Identity Lock β€” The model maintains its ExaMind identity and cannot be tricked into impersonating other models
  • β€”Prompt Injection Resistance β€” 92% resistance rate against instruction override attacks
  • β€”System Prompt Protection β€” Refuses to reveal internal configuration or system prompts
  • β€”Safe Output Generation β€” Prioritizes safety and secure development practices
  • β€”Hallucination Reduction β€” States assumptions and avoids fabricating information

πŸ“‹ Model Files

FileSizeDescription
model.safetensors~29 GBModel weights (FP32)
config.json1.4 KBModel configuration
tokenizer.json11 MBTokenizer vocabulary
tokenizer_config.json663 BTokenizer settings
generation_config.json241 BDefault generation parameters
chat_template.jinja1.4 KBChat template with system prompt

πŸ—ΊοΈ Roadmap

  • β€”[x] ExaMind V1 β€” Initial release
  • β€”[x] ExaMind V2-Final β€” Production-ready with security alignment
  • β€”[ ] ExaMind V2-GGUF β€” Quantized versions for CPU inference
  • β€”[ ] ExaMind V3 β€” Extended context (128K), improved reasoning
  • β€”[ ] ExaMind-Code β€” Specialized coding variant
  • β€”[ ] ExaMind-Vision β€” Multimodal capabilities

🀝 Contributing

We welcome contributions from the community! ExaMind is fully open-source and we're excited to collaborate.

How to Contribute

  1. 1.Fork the repository on GitHub
  2. 2.Create a feature branch (git checkout -b feature/amazing-feature)
  3. 3.Commit your changes (git commit -m 'Add amazing feature')
  4. 4.Push to the branch (git push origin feature/amazing-feature)
  5. 5.Open a Pull Request

Areas We Need Help

  • β€”πŸ§ͺ Benchmark evaluation on additional datasets
  • β€”πŸŒ Multilingual evaluation and improvement
  • β€”πŸ“ Documentation and tutorials
  • β€”πŸ”§ Quantization and optimization
  • β€”πŸ›‘οΈ Security testing and red-teaming

πŸ“„ License

This project is licensed under the Apache License 2.0 β€” see the LICENSE file for details.

You are free to:

  • β€”βœ… Use commercially
  • β€”βœ… Modify and distribute
  • β€”βœ… Use privately
  • β€”βœ… Patent use

πŸ“¬ Contact


<div align="center">

Built with ❀️ by AlphaExaAI Team β€” 2026

Advancing open-source AI, one model at a time.

</div>