Modelpublic

omar81939/Ouro-1.4B-Thinking-depth-SFT

sourceHugging Faceapache-2.0updated 1mo agoView on Hugging Face

0likes40downloads

Model Card

Usage

python

from transformers import AutoModelForCausalLM, AutoTokenizer

REPO = "omar81939/Ouro-1.4B-Thinking-depth-SFT"
DEPTH = 16

tokenizer = AutoTokenizer.from_pretrained(REPO)
model = AutoModelForCausalLM.from_pretrained(
    REPO,
    trust_remote_code=True,
    dtype="bfloat16",
    total_ut_steps=DEPTH,
)

With vLLM, set hf_overrides={"total_ut_steps": DEPTH} when creating the engine.