atrost/climbmix-stairformer-353m-1p2b-h100-vllm

atrost/climbmix-stairformer-353m-1p2b-h100-vllm

vLLM Transformers-backend packaging of atrost/climbmix-stairformer-353m-1p2b-h100.

This repo keeps the original weights and adds an auto_map.AutoModel entry plus remote code whose StairFormer customization lives in StairFormerModel, the base model class required by vLLM's Transformers backend.

• —Source checkpoint: atrost/climbmix-stairformer-353m-1p2b-h100
• —Source revision: 4de1d6dfc052d2fe944485d68a6db0588dd70acc

from transformers import AutoModelForCausalLM, AutoTokenizer

repo_id = "atrost/climbmix-stairformer-353m-1p2b-h100-vllm"
tokenizer = AutoTokenizer.from_pretrained(repo_id)
model = AutoModelForCausalLM.from_pretrained(
    repo_id,
    trust_remote_code=True,
    torch_dtype="auto",
)

from vllm import LLM

llm = LLM(model="atrost/climbmix-stairformer-353m-1p2b-h100-vllm", trust_remote_code=True, model_impl="transformers")