Apppublic

LabrvUaem/chatbot-uaemex

sourceHugging Faceupdated 1y agoView on Hugging Face

0likes

loader.py11 linesDownload Raw Back to model

1import torch2from transformers import pipeline3from config.settings import MODEL_ID4 5pipe = pipeline(6    "text-generation",7    model=MODEL_ID,8    torch_dtype=torch.bfloat16,9    device_map="auto",10    return_full_text=False11)