Modelpublic

Kolyadual/MIXdevAI-yandexGPT5-8B

sourceHugging Faceapache-2.0updated 5mo agoView on Hugging Face

0likes9downloads

Model Card

MIXdevAI-yandexGPT5-8B

Модель разработанная путем слияния YandexGPT-5-Lite-8B-instruct (70%) и Saiga YandexGPT 8B (30%).

Быстрый старт

python

from transformers import AutoModelForCausalLM, AutoTokenizer

model = AutoModelForCausalLM.from_pretrained("Kolyadual/MIXdevAI-yandexGPT5-8B", device_map="auto", torch_dtype="auto")
tokenizer = AutoTokenizer.from_pretrained("Kolyadual/MIXdevAI-yandexGPT5-8B")

messages = [{"role": "user", "content": "Привет! Как дела?"}]
inputs = tokenizer(tokenizer.apply_chat_template(messages, tokenize=False), return_tensors="pt").to(model.device)
print(tokenizer.decode(model.generate(**inputs, max_new_tokens=512)[0], skip_special_tokens=True))