darthcrawl/artifex-rp-orpheus-llama-3.1-8b-lora

from peft import PeftModel
from transformers import AutoModelForCausalLM, AutoTokenizer
import torch

base_id = "meta-llama/Llama-3.1-8B-Instruct"
adapter_id = "darthcrawl/artifex-rp-orpheus-llama-3.1-8b-lora"

tok = AutoTokenizer.from_pretrained(base_id, use_fast=True)
model = AutoModelForCausalLM.from_pretrained(
    base_id,
    torch_dtype=torch.bfloat16,
    device_map="auto",
)
model = PeftModel.from_pretrained(model, adapter_id)

Write in vivid, restrained, intelligent prose. Concrete sensory detail.
Never pretentious. Tension carries more weight than description.
Match the user's energy and length.