ncterry1/local-llm-lab
02
local-llm-lab
This model is a custom fine-tuned LLaMA-7B model for knowledge graph summarization.
Usage
from transformers import AutoModelForCausalLM, AutoTokenizer
tokenizer = AutoTokenizer.from_pretrained("ncterry1/local-llm-lab")
model = AutoModelForCausalLM.from_pretrained("ncterry1/local-llm-lab")
prompt = "Explain a knowledge graph in one sentence."
inputs = tokenizer(prompt, return_tensors="pt")
outputs = model.generate(inputs.input_ids, max_new_tokens=50)
print(tokenizer.decode(outputs[0], skip_special_tokens=True))