ParallaxOpen/Vela-Lumen-15M

Vela 15M Preview

A 15M-parameter math content generator trained from scratch on a single 8GB laptop GPU.

Preview: This is an early version. More training data and better results coming soon.

Downloads

Quick Start (Ollama)

wget https://huggingface.co/ParallaxOpen/Vela-Lumen-15M/resolve/main/vela-lumen-15m-f16.gguf
cat > Modelfile << EOF
FROM vela-lumen-15m-f16.gguf
TEMPLATE "{{ .System }}{{ .Prompt }}"
SYSTEM "You are a math tutor."
EOF
ollama create vela-15m-preview -f Modelfile
ollama run vela-15m-preview

What It Does

Math Content Generation:

• —Generates math word problems and equations
• —Generates homework-style questions
• —Generates math explanations and tutorials
• —Generates LaTeX formulas

Example:

Prompt: "Create a math problem about:"
Output: "The expression (x/m * x) - (x/m * x) = x.
        Recall that (x/m * x) - (x/m * x) = x.
        Therefore, we can solve for..."

ELO Rating

Comparison

Model Details

Training

• —Pretrain: 7B tokens, 200K steps, loss 2.5, ~10h on RTX 5060
• —SFT: 14K math samples, 5K steps, loss 3.32, ~30min on RTX 5060
• —Total: ~10 hours on a single 8GB laptop GPU

What's Next

• —More pretrain data (FineMath 50B tokens)
• —Better SFT with distilled data
• —Larger model (50M+ params)
• —Improved math reasoning

Citation

@software{vela-15m-preview,
  title={Vela 15M Preview: A 15M-param Math Content Generator},
  author={ParallaxOpen},
  year={2026},
  note={Preview version - trained on a single RTX 5060 Laptop GPU}
}