CoolFace
Modelpublic

clemsail/micro-kiki-v3

sourceHugging Faceapache-2.0updated 5mo agoView on Hugging Face
4likes50downloads
Model Card

micro-kiki

35-domain expert model built on Qwen3.5-35B-A3B (MoE, 256 experts, 3B active/token) with LoRA adapters and a cognitive layer (memory palace + negotiator + anti-bias).

Model Description

micro-kiki is a multi-domain language model designed for technical applications spanning electronics, firmware, CAD, manufacturing, and general-purpose conversation. It uses a router-based architecture that selects up to 4 domain-specific LoRA stacks per request.

PropertyValue
Base modelQwen3.5-35B-A3B
ArchitectureMoE (256 experts, 3B active/token)
AdapterLoRA rank 16 (q/k/v/o projections)
Domains35
Max active stacks4
Context length262,144 tokens
QuantizationQ4KM (inference), BF16 (training)
LicenseApache 2.0

Architecture

                         +-------------------+
                         |   Domain Router   |
                         | (classifier, top4)|
                         +--------+----------+
                                  |
              +----------+--------+--------+----------+
              |          |                 |          |
         +----v----+ +---v---+       +----v----+ +---v---+
         | Stack 1 | |Stack 2|  ...  |Stack 34 | |Stack35|
         | chat-fr | |python |       |ml-train | |securi.|
         +---------+ +-------+       +---------+ +-------+
              |          |                 |          |
              +----------+--------+--------+----------+
                                  |
                         +--------v----------+
                         |    Negotiator     |
                         | CAMP + Catfish    |
                         +--------+----------+
                                  |
                         +--------v----------+
                         |    Anti-Bias      |
                         | KnowBias + RBD   |
                         +--------+----------+
                                  |
                         +--------v----------+
                         |   Aeon Memory     |
                         | Atlas + Trace     |
                         +-------------------+

Intended Use

  • —French/English conversational AI with domain expertise
  • —Code generation (Python, C/C++, Rust, TypeScript, embedded firmware)
  • —Electronics design (KiCad DSL, schematic review, component selection, SPICE)
  • —Manufacturing (process optimization, quality control)
  • —Multi-domain routing with cognitive arbitration

Limitations

  • —Not designed for medical, legal, or financial advice
  • —Optimized for technical domains; general knowledge may be weaker than base model
  • —Requires Q4KM or higher quantization; quality degrades below Q4
  • —Maximum 4 concurrent LoRA stacks; performance varies with stack combinations
  • —Memory (Aeon) requires external backends (Qdrant/Neo4j) for production use

Training Data — V3 (489K examples, 35 domains)

Sources

SourceExamplesDescription
Claude CLI sessions50,116Real user-tool interactions extracted from 5 machines (GrosMac, kxkm-ai, Studio, Tower, CILS)
Codex/Copilot sessions2,529OpenAI Codex + GitHub Copilot sessions extracted from 4 machines
HuggingFace datasets364,04519 open datasets (see below)
Opus teacher distillation—chat-fr, reasoning domains
Original curated—32 domain seed datasets

HuggingFace Datasets

DatasetExamplesLicense
CodeFeedback-Filtered-Instruction157,000Apache 2.0
French-Alpaca-Instruct-110K110,000Apache 2.0
Electronics StackExchange95,000CC-BY-SA-3.0
CJJones/LLMEEEducationalSyntheticDialog50,000CC-BY-NC-SA-4.0
MuratKomurcu/stm32-hal-dataset29,700MIT
redcathode/thingiverse-openscad7,400—
ThomasTheMaker/OpenSCAD4,900—
STEM-AI-mtl/Electrical-engineering1,100—
JITX open-components-database151—
Vrindarani/netlistgen106—

35 Domains

GroupDomains
Conversationchat-fr, reasoning
Codepython, typescript, cpp, rust, html-css, shell, sql, yaml-json, lua-upy
Infrastructuredocker, devops, llm-orch, llm-ops (NEW), ml-training (NEW)
Electronicskicad-dsl, kicad-pcb, spice, electronics, components (NEW), power, emc, dsp
Hardwareembedded, stm32, iot, platformio
CADfreecad
Webweb-frontend, web-backend
Othermusic-audio, math, security

Changes from V2: 3 new domains (components, llm-ops, ml-training). spice-sim merged into spice. stm32 is a sub-category of embedded.

New Domain: components

57K Q&A about electronic component specs, datasheets, sourcing, BOM, and cross-reference. Sources: Electronics StackExchange (filtered by component tags) + JITX open-components-database.

Training — V3

PropertyValue
Base modelQwen3.5-4B
AdapterMoE-LoRA: 4 experts/projection, rank 16, top-2 routing
Null-space projectionENABLED (prevents catastrophic forgetting between stacks)
CurriculumSequential, 35 stacks trained in order
Platform (MLX)Mac Studio M3 Ultra 512 GB
Platform (CUDA)kxkm-ai RTX 4090 24 GB

Evaluation

MetricValue
Router accuracy (35-class)[PENDING]
Forgetting check (angle)[PENDING]
Perplexity (base)[PENDING]
Perplexity (debiased)[PENDING]
Aeon recall@1[PENDING]
Aeon recall@5[PENDING]
Aeon recall@10[PENDING]
Anti-bias flag rate[PENDING]
Average inference latency[PENDING]

Hardware Requirements

SetupRAM/VRAMUse
Mac Studio M3 Ultra512 GB unifiedTraining (BF16 LoRA) + serving (MLX)
RTX 409024 GB VRAMQ4 inference (vLLM)
Apple Silicon 32 GB+32 GB unifiedQ4KM inference (MLX/llama.cpp)

Citation

bibtex
@misc{micro-kiki-2026,
  title={micro-kiki: Multi-Domain Expert Model with Cognitive Layer},
  author={L'Electron Rare},
  year={2026},
  url={https://huggingface.co/electron-rare/micro-kiki}
}

Related Projects & Ecosystem

micro-kiki-v3 is one component of the FineFab platform built by [L'Électron Rare](https://github.com/L-electron-Rare) — a local-first, multi-machine AI-native manufacturing and electronics platform.

RoleProjectDescription
Training toolkitL-electron-Rare/KIKI-Mac_tunnerMLX fine-tuning toolkit (Mac Studio) — Opus reasoning distilled into Mistral Large 123B
Fine-tuning pipelineL-electron-Rare/KIKI-models-tuningFineFab fine-tuning pipeline — training, evaluation, registry (Unsloth, LoRA)
Methodologyelectron-rare/Kill_LIFESpec-first agentic methodology for embedded systems — BMAD agents, gates, evidence packs
Orchestrationelectron-rare/mascaradeMulti-machine agentic LLM orchestration — P2P mesh, 8 providers, RAG pipeline
AI backendL-electron-Rare/life-coreFineFab AI backend — LLM router, RAG, caching, orchestration
CAD assistantelectron-rare/KiC-AIAI-powered PCB design assistant for KiCad

See the full org at [github.com/L-electron-Rare](https://github.com/L-electron-Rare) — 13 public repos covering platform, hardware, firmware, CAD, and ML.

Infrastructure: the 50K+ Claude CLI examples in the training dataset were captured on our 5-node P2P mesh — GrosMac (Apple M5), Tower (28 threads), CILS (i7), KXKM-AI (RTX 4090), VM bootstrap. Ed25519 auth, DHT discovery.

🇪🇺 EU AI Act transparency

This adapter is provided as a fine-tuned LoRA under the AI Act framework (Regulation EU 2024/1689). Compliance metadata:

FieldValue
ProviderL'Électron Rare (clemsail / electron-rare)
Role under AI ActGPAI provider for this adapter
Base modelQwen/Qwen3.5-35B-A3B — see upstream provenance
Adapter typeLoRA / PEFT — adapter weights only; base unchanged
Training data originL'Électron Rare proprietary technical corpus + curated public docs
LicenseApache-2.0 (adapter). Upstream base licence applies separately.
Intended useMulti-domain technical assistance — engineering, KiCad, embedded, code, FR/EN chat
Out of scopeHealthcare diagnosis, legal advice, autonomous safety-critical decisions, generation of malicious code
Risk classificationLimited risk — Article 50 transparency obligations apply
Copyright respectTraining data does not include scraped copyrighted material. Opt-out signals (robots.txt, ai.txt) are honoured for web-sourced data.
Full provenancehttps://github.com/L-electron-Rare/eu-kiki/tree/main/docs/provenance
Contactpostmaster@saillant.cc — biased output reports, copyright concerns, etc.

⚠️ You are using an AI model. Outputs may be inaccurate, biased or fabricated. Do not act on them without independent verification, especially in regulated domains.