CoolFace
Apppublic

fabricioslv/transformer-mps-bridge-experiment

sourceHugging Facemitupdated 2mo agoView on Hugging Face
0likes
App README

Transformer ↔ MPS Bridge Experiment

Analyzes the internal structure of LLM hidden states using Matrix Product State (MPS) decomposition.

Questions

  1. 1.What is the effective rank of hidden states per layer? (SVD)
  2. 2.What bond dimension χ saturates MPS reconstruction? (MPS)
  3. 3.Does the hidden state have natural structure matching the 12 Dodecatíade houses?

Reference

RSI 27q quantum circuit saturated at χ=32 (Aer MPS). If the Transformer hidden state saturates at similar χ, the MPS bridge is viable.