WangKaiLin/PipeOwl-1.8-jp-parameter-golf
05
PipeOwl-1.8-jp-parameter-golf (Geometric Embedding)
A transformer-free semantic retrieval engine.
PipeOwl performs deterministic vocabulary scoring over a static embedding field:
score = α⋅base + β⋅Δfield
where:
- base = cosine similarity in embedding space
- Δfield = static scalar field bias
Features:
- O(n) over vocabulary.
- No attention.
- No transformer weights.
- CPU-friendly (<16MB model)
Architecture
- Static embedding table (V × D)
- Aligned vocabulary index
- Optional scalar bias field (Δfield)
- Linear scoring
- Pluggable decoder stage
- Targeted for CPU environments and low-latency systems (e.g. IME).
Model Specs
Quickstart
git clone https://huggingface.co/WangKaiLin/PipeOwl-1.8-jp-parameter-golf
cd PipeOwl-1.8-jp-parameter-golf
pip install numpy safetensors
python quickstart.pyExample:
Example semantic retrieval results:
Please enter words: 東京
Top-K Tokens:
1.000 | 東京
0.739 | 東京都
0.679 | 大阪
0.666 | ロンドン
0.646 | 名古屋
Please enter words: 大阪
Top-K Tokens:
1.000 | 大阪
0.756 | 関西
0.728 | 難波
0.717 | 京都
0.712 | 守口
Benchmark (CPU)
Environment:
- Vocab size: 26,155
- Embedding dimension: 256
- Hardware: CPU
Average query latency: maybe faster this is PipeOwl-1.6-jp benchmark
PipeOwl: 0.0036 sec BM25: 0.0421 sec Embedding: 0.0283 sec FAISS Flat: 0.0324 sec FAISS HNSW: 0.0230 sec
PipeOwl shows 6–12× lower latency compared with common retrieval baselines in this setup.
Repository Structure
PipeOwl-1.8-jp-parameter-golf/
├ README.md
├ config.json
├ LICENSE
├ quickstart.py
├ engine.py
├ vocabulary.json
└ pipeowl_fp16.safetensorsLICENSE
MIT
