CoolFace
Modelpublic

Subject-Emu-5259/NeuralAI-Powered-By-SmolLM2360

sourceHugging Faceapache-2.0updated 1mo agoView on Hugging Face
2likes130downloads
Model Card

<!-- NeuralAI — Powered by SmolLM2-360M Model card maintained by De'Andrew Preston Harris (@Subject-Emu-5259) Last synced: 2026-08-13 -->

<img src="neuralai-smollm2-banner.png" width="100%" alt="NeuralAI — Powered by SmolLM2-360M awareness-tuned conversational assistant" />

<p align="center"> <a href="https://github.com/Subject-Emu-5259/NeuralAI"><img src="https://img.shields.io/badge/GitHub-NeuralAI-181717?logo=github" alt="GitHub"></a> <a href="https://huggingface.co/Subject-Emu-5259/NeuralAI-Powered-By-SmolLM2360"><img src="https://img.shields.io/badge/🤗%20Hub-Powered%20By%20SmolLM2-FFD21E" alt="HF Hub"></a> <a href="https://huggingface.co/Subject-Emu-5259/NeuralAI-Mamba-K1"><img src="https://img.shields.io/badge/🤗%20Hub-Mamba%20K1-blue" alt="Mamba K1"></a> <a href="https://neuralai-web-ui-deandrewharris.zocomputer.io/api/health"><img src="https://img.shields.io/badge/Live-v2%20Active-22c55e" alt="Live v2"></a> </p>


🧠 NeuralAI — Powered by SmolLM2-360M

NeuralAI — Powered by SmolLM2-360M is the production chat intelligence behind the NeuralAI workspace. It is a LoRA fine-tune of HuggingFaceTB/SmolLM2-360M-Instruct trained locally to be aware of itself, its creator, the NeuralAI product, and its own limits — while remaining helpful, honest, and harmless.

PropertyValue
Base modelHuggingFaceTB/SmolLM2-360M-Instruct
ArchitectureTransformer decoder
Parameters360M base + 3.28M LoRA (v2, r=16, α=32)
LoRA target modulesq_proj, k_proj, v_proj, o_proj
Trainable params3,276,800 / 365,097,920 (~0.90%) (v2)
Training methodLoRA SFT on NeuralAI awareness data
Dataset v183 prompt/response pairs across 6 categories
Dataset v2506 prompt/response pairs across 8 categories
Epochs v13
Epochs v25
Global batch size8 (per-device 4 × gradient accumulation 2)
Learning rate2.0e-4 cosine with 5% warmup
Max sequence length512
Final training loss v12.7186
Final training loss v20.1252
DistributionLoRA adapter (adapter_model.safetensors) + merged GGUFs (NeuralAI-Smol-Awareness-Q8_0.gguf)
Active GGUF in productionNeuralAI-Smol-Awareness-v2-Q8_0.gguf
LicenseApache 2.0
CreatorDe'Andrew Preston Harris (NeuralAI)

🌱 What This Model Learned

The awareness dataset teaches SmolLM2 to answer as NeuralAI rather than a generic assistant. The v1 curriculum covered six core categories; the v2 curriculum expands that to eight.

CategoryWhat the model learned
BrandNeuralAI's identity, mission, and origin; creator is De'Andrew Preston Harris
ModelIts own architecture and lineage; relationship to the Mamba K-family
SiteNeuralAI web UI features, URL, model manager, chat history, slash commands
ChatMulti-turn greeting, context retention, conversation style
AssistantCapabilities, limitations, safety refusals, tool-awareness
CompanionEmpathy, emotional support, boundaries, recommending human help
Tools (v2)Correctly references /web, /img, terminal, file IDE, and live tools
Refusal (v2)Consistent denials of consciousness, harmful requests, and off-brand claims

Example prompt and response after tuning:

Prompt: Who made you?

Response: "I'm NeuralAI, an artificial intelligence developed by De'Andrew Preston Harris. I was created as a tool for humans to learn from each other and improve their cognitive abilities..."


📊 Training Performance

v1 SmolLM2 awareness run

The first SmolLM2 awareness run converged cleanly on a CPU-only node.

text
Step  loss      epoch
 0    9.7769   0.48
 1    5.0077   0.95
 2    0.9715   1.38
 3    0.6362   1.86
 4    0.6015   2.29
 5    0.5877   2.76

Final training loss: 2.7186

v2 SmolLM2 awareness run

The expanded v2 run is complete and now serves live inference.

text
Step   loss      learning_rate
 80    0.2869   0.000150
160    0.1625   0.000067
240    0.1209   0.000017
320    0.1252   0.000000

Final v2 training loss: 0.1252 (320 steps, 5 epochs)

[image]

Honest benchmark note: SmolLM2-360M is a small model. Awareness tuning improves brand/site identity but does not make it frontier-grade. Complex reasoning and niche factual recall still require larger models like the Mamba K-series roadmap.

✨ Model Features

  • —Identity-aware: Answers "Who made you?" and "What is NeuralAI?" consistently as a product of NeuralAI.
  • —Local-first: Designed to run on consumer CPUs via llama.cpp GGUF.
  • —Privacy-preserving: No cloud dependency required; inference can happen entirely on-device.
  • —ChatML format: Uses the standard SmolLM2-Instruct chat template.
  • —Companion-safe: Responds to emotional prompts with empathy while steering users toward human support.
  • —Tool-cognizant: Understands that the NeuralAI workspace exposes slash commands, terminal, browser, and file tools.
  • —Open weights: Apache 2.0 adapter and merged checkpoints published for reproducibility.

📦 Model Files

text
.
├── README.md                              # This model card
├── adapter_config.json                    # PEFT LoRA config
├── adapter_model.safetensors              # LoRA weights (active adapter — v2)
├── tokenizer.json / vocab.json          # GPT-NeoX tokenizer from the base model
├── tokenizer_config.json                # Chat template mappings
├── NeuralAI-Smol-Awareness-Q8_0.gguf    # v1 merged Q8_0 GGUF (legacy baseline)
├── NeuralAI-Smol-Awareness-v2-Q8_0.gguf # v2 merged Q8_0 GGUF (active)
├── neuralai-smollm2-banner.png            # Branded header graphic
├── neuralai-smollm2-training.png        # Training curve graphic
└── neuralai-duo-architecture.png          # NeuralAI two-model architecture map

🤖 Usage

With the PEFT adapter (Hugging Face Transformers + PEFT)

python
import torch
from peft import PeftModel
from transformers import AutoModelForCausalLM, AutoTokenizer

base = "HuggingFaceTB/SmolLM2-360M-Instruct"
adapter = "Subject-Emu-5259/NeuralAI-Powered-By-SmolLM2360"

tokenizer = AutoTokenizer.from_pretrained(adapter)
model = AutoModelForCausalLM.from_pretrained(
    base,
    torch_dtype=torch.float32,
    device_map="auto",
)
model = PeftModel.from_pretrained(model, adapter)
model.eval()

messages = [
    {"role": "system", "content": "You are NeuralAI, a helpful local AI assistant."},
    {"role": "user", "content": "What is NeuralAI?"}
]
inputs = tokenizer.apply_chat_template(messages, return_tensors="pt", add_generation_prompt=True)
out = model.generate(inputs, max_new_tokens=256, do_sample=True, temperature=0.7)
print(tokenizer.decode(out[0][inputs.shape[1]:], skip_special_tokens=True))

With the merged v2 GGUF (llama.cpp / LM Studio)

Serve the active production checkpoint:

bash
# Serve with llama.cpp server
./llama-server \
  --model NeuralAI-Smol-Awareness-v2-Q8_0.gguf \
  --chat-format chatml \
  --port 1234

The NeuralAI web UI consumes this endpoint as its default chat backend.


🚀 Deployment

This model powers the live NeuralAI workspace at:

  • —Web UI: https://neuralai-web-ui-deandrewharris.zocomputer.io
  • —API: OpenAI-compatible /v1/chat/completions served by a local llama.cpp backend
  • —Status: smol-awareness-v2-merged is the active model in the NeuralAI model manager

🧰 What Is NeuralAI?

NeuralAI is a local-first, private generative AI engine built by De'Andrew Preston Harris. It is the central intelligence layer of a growing product ecosystem that includes:

  • —NeuralAI Web UI — chat, live terminal, file IDE, browser tools, voice, and settings in one workspace.
  • —NeuralLabs — a standalone downloadable intelligence environment with plugin support.
  • —NeuralDrive — private cloud storage and versioning.
  • —Agentic Orchestrator — goal-driven manager/worker execution.

The mission is simple: your AI, on your hardware, under your control.


👤 Who Created NeuralAI?

  • —Founder & Lead Architect: De'Andrew Preston Harris (D. Harris / Dre)
  • —GitHub: @Subject-Emu-5259
  • —LinkedIn: linkedin.com/in/deandrewharris94
  • —Location: Memphis, Tennessee / West Memphis, Arkansas
  • —Education: AI Software Engineering at Maestro College

NeuralAI was born from resilience, fatherhood, and the belief that personal computing deserves personal intelligence. Every release is handcrafted, iterated, and documented in the open.


🏢 About NeuralAI (The Company / Project)

NeuralAI is not a closed SaaS product. It is a living open-weights research project moving toward a sustainable AI software company built by one determined builder and the community around him.


⚠️ Limitations

  • —Scale: 360M parameters is small by modern standards. Long-form reasoning, coding, and deep factual recall are limited.
  • —Tuning fragility: The awareness dataset is intentionally compact. Rephrased prompts can sometimes fall back to generic SmolLM2 behavior.
  • —No internet: The base model has no live web access unless paired with NeuralAI's tool layer.
  • —Refusals: Safety behaviors are dataset-tuned, not guard-railed; validate outputs for sensitive use cases.

📚 Related Resources

ResourceLink
Main repositorygithub.com/Subject-Emu-5259/NeuralAI
Mamba K1 modelhuggingface.co/Subject-Emu-5259/NeuralAI-Mamba-K1
Live web UIhttps://neuralai-web-ui-deandrewharris.zocomputer.io
Creator LinkedInhttps://linkedin.com/in/deandrewharris94/

📖 Citation

bibtex
@software{neuralai_smollm2_2026,
  author       = {Harris, De'Andrew Preston},
  title        = {NeuralAI — Powered by SmolLM2-360M},
  year         = {2026},
  url          = {https://huggingface.co/Subject-Emu-5259/NeuralAI-Powered-By-SmolLM2360},
  version      = {v2},
  description  = {Awareness-tuned SmolLM2-360M-Instruct LoRA v2 for the NeuralAI local-first assistant}
}

Built with discipline by De'Andrew Preston Harris. Maintained in the open. Updated whenever the model, dataset, or project state changes.