CoolFace
Modelpublic

Prannesshkva/QU-SSM-15M

sourceHugging Faceotherupdated 6d agoView on Hugging Face
2likes3.9kdownloads
Model Card

๐Ÿ›๏ธ QU-SSM-15M: Continuous Quasi-Unitary State Space Foundation Model

### ๐Ÿ“„ Official Research Paper (PDF) & Open Verification Title: "Gated Quasi-Unitary Lie-Algebra Recurrent State Space Models" Author: Prannessh K.V.A. (@prannesshkva) ๐Ÿ“ฅ [Download Full Research Paper (PDF)](https://huggingface.co/Prannesshkva/QU-SSM-15M/resolve/main/Gated_Quasi_QU_SSM_Paper.pdf) | ๐Ÿ›๏ธ [Zenodo DOI: 10.5281/zenodo.22283431](https://doi.org/10.5281/zenodo.22283431) | ๐ŸŽฎ [Live Interactive Space](https://huggingface.co/spaces/Prannesshkva/QU-SSM-Scientific-Benchmark-Suite)

![Official Paper](https://huggingface.co/Prannesshkva/QU-SSM-15M/resolve/main/GatedQuasiQUSSMPaper.pdf) ![Zenodo DOI](https://doi.org/10.5281/zenodo.22283431) ![LinkedIn Profile](https://www.linkedin.com/in/prannesshkva/) ![License: CC BY-NC-ND 4.0](https://creativecommons.org/licenses/by-nc-nd/4.0/) ![Model: qu_ssm-15M](https://huggingface.co/Prannesshkva/QU-SSM-15M) ![Flagship: qu_ssm-130Moe](https://huggingface.co/Prannesshkva/QU-SSM-130M-MoE)

QU-SSM-15M is the lightweight dense foundation sequence model of the QU-SSM family, designed and invented by Prannessh K.V.A. (Sole Architect & Inventor). Built for embedded edge hardware and micro-controllers, it delivers continuous Lie-group unitary recurrence on SO(2) โ‰… U(1) with dense SwiGLU representations (29.80M parameters).


๐Ÿงฌ Base Model Lineage & Technical Notes

  • โ€”Core Architecture: Dense Continuous Quasi-Unitary Recurrent State Space Foundation Model (SO(2) Lie-group dynamics).
  • โ€”Tokenizer Lineage: Initialized with standard GPT-NeoX / Pythia vocabulary (50,277 tokens).
  • โ€”Pre-training & Calibration: Pre-trained from scratch on roneneldan/TinyStories for ultra-low latency edge devices, microcontrollers, and embedded hardware.
  • โ€”Parameter Footprint: 29.80M Physical Parameters (dense SwiGLU projections, dmodel=256, dstate=16, 6 layers).
  • โ€”Mathematical Invariant: Exact Euclidean norm preservation (||R(theta)||_2 = 1.000) preventing contractive dissipation.
  • โ€”Official Research Contact: LinkedIn — Prannesh K. V. A.

๐Ÿ” What is QU-SSM?

QU-SSM is a state-of-the-art linear-time sequence architecture that replaces real-valued negative dissipation (e^(-ฮฑยทt) โ†’ 0) with non-dissipative SO(2) phase rotations (โ€–R(ฮธ)โ€–โ‚‚ โ‰ก 1.00000).


๐Ÿ”’ Intellectual Property & Citation


๐Ÿ”— Related QU-SSM Hub Repositories