fabricioslv/transformer-mps-bridge-experiment
0
Transformer ↔ MPS Bridge Experiment
Analyzes the internal structure of LLM hidden states using Matrix Product State (MPS) decomposition.
Questions
- What is the effective rank of hidden states per layer? (SVD)
- What bond dimension χ saturates MPS reconstruction? (MPS)
- Does the hidden state have natural structure matching the 12 Dodecatíade houses?
Reference
RSI 27q quantum circuit saturated at χ=32 (Aer MPS). If the Transformer hidden state saturates at similar χ, the MPS bridge is viable.
