CoolFace
Modelpublic

QuerynAi/queryn-adapter-me5-large_to_nemotron-1b-free

sourceHugging Facemitupdated 27d agoView on Hugging Face
0likes23downloads
Model Card

Queryn adapter — me5-large → nemotron-1b-free

Translates an embedding produced by me5-large into the embedding space of nemotron-1b-free, so a corpus already embedded with me5-large can be served against a nemotron-1b-free index without re-embedding it. Part of the Queryn embedding-translation engine.

Specs

Source modelme5-large (1024-d)
Target modelnemotron-1b-free (2048-d)
Architecturedeep (1 hidden layer, GELU, compressed latent)
Parameters~1.6M
Best test cosine similarity0.6440 (epoch 15)
ONNX opset17

Architecture ablation (best test cosine): linear 0.6395, deep 0.6440 ← saved.

Input / output contract

  • —Input source_embedding — float32, shape [batch, 1024]. Raw me5-large embeddings; the graph L2-normalizes them itself, so pre-normalization is neither required nor harmful.
  • —Output target_embedding — float32, shape [batch, 2048], unit-normalized, in nemotron-1b-free space.
  • —Batch axis is dynamic.

Usage

python
import numpy as np, onnxruntime as ort
from huggingface_hub import hf_hub_download

path = hf_hub_download("QuerynAi/queryn-adapter-me5-large_to_nemotron-1b-free", "model.onnx")
sess = ort.InferenceSession(path, providers=["CPUExecutionProvider"])

src = np.random.rand(4, 1024).astype(np.float32)   # your me5-large embeddings
tgt = sess.run(["target_embedding"], {"source_embedding": src})[0]
assert tgt.shape == (4, 2048)                     # unit vectors in nemotron-1b-free space

Training

Trained on paired embeddings over a unified multi-domain corpus — arXiv abstracts, Australian case law, SQuAD passages, PubMed abstracts, and crypto/markets news (~350k rows spanning science, legal, QA, medical, and finance). Loss: 1 - mean cosine similarity, Adam, ReduceLROnPlateau, best-epoch checkpoint. Both a linear baseline and the MLP are trained for every pair; the higher-scoring one is published (ties go to linear).

Plots

[image]

`me5-large` → all targets: learning curves and best scores (this pair included).

[image]

Linear vs. deep for every pair (black ring = saved architecture).

Full adapter set: Queryn Embedding Adapters

Provenance

  • —Source checkpoint: models/v1/me5-large_to_nemotron-1b-free.pt (sha256 b8d8c7c9ed231ef8…)
  • —Converted: 2026-08-30T20:45:23+00:00 · torch 2.13.0 · ptConverter.py

License

Released under the MIT license.