Modelpublic

silvercoder67/Mistral-7b-instruct-v0.2-summ-sft-e2m

sourceHugging Facecc-by-nc-4.0updated 3y agoView on Hugging Face

0likes63downloads

Model Card

Description to load and test will be added soon. More details on training and data will be added aswell.

Loading the Model

Use the following Python code to load the model:

python

import torch
from transformers import AutoModelForCausalLM, AutoTokenizer

TBD

Generating Text

To generate text, use the following Python code:

python

text = "Hi, my name is "
inputs = tokenizer(text, return_tensors="pt")

outputs = model.generate(**inputs, max_new_tokens=64)
print(tokenizer.decode(outputs[0], skip_special_tokens=True))