CoolFace
Modelpublic

trumancai/Revela-code-500M

sourceHugging Faceapache-2.0updated 1y agoView on Hugging Face
0likes315downloads
Model Card

Model Summary

Revela-code-500M is a self-supervised code retriever built on the 3 B-parameter Qwen2.5-0.5B backbone. It was trained on 358 K batches of code-centric text (Stack Overflow, tutorials, API docs) using the Revela next-token-prediction + in-batch attention objective. Use it for code-search, question-answer navigation, or hybrid doc/code retrieval.

Other Links

BinaryDescription
trumancai/Revela-code-3b3 B-parameter code-retriever.
trumancai/Revela-code-1b1 B-parameter code-retriever.
trumancai/Revela-code-500M500 M-parameter code-retriever.
trumancai/Revela-3b3 B-parameter Wikipedia retriever.
trumancai/Revela-1b1 B-parameter Wikipedia retriever.
trumancai/Revela-500M500 M-parameter Wikipedia retriever.
trumancai/revela_code_training_corpusCode training corpus.
trumancai/revela_training_corpusWikipedia training corpus.

Usage

python
from mteb.model_meta import ModelMeta
from mteb.models.repllama_models import RepLLaMAWrapper, _loader
import mteb, torch

revela_llama_code_3b = ModelMeta(
    loader=_loader(
        RepLLaMAWrapper,
        base_model_name_or_path="meta-llama/Llama-3.2-3B",
        peft_model_name_or_path="trumancai/Revela-code-3b",
        device_map="auto",
        torch_dtype=torch.bfloat16,
    ),
    name="trumancai/Revela-code-3b",
    languages=["eng_Latn"],
    open_source=True,
    revision="974f4d8e7ff5d5439cc1863088948249f612c284",
    release_date="2025-10-07",
)

model = revela_llama_code_3b.loader()

mteb.MTEB(tasks=["AppsRetrieval"])
    .run(model=model, output_folder="results/Revela-code-3b")

License

Citation