CoolFace
Modelpublic

mrfakename/Apriel-5B-Instruct-llamafied

sourceHugging Facemitupdated 1y agoView on Hugging Face
4likes215downloads
Model Card

Apriel 5B Instruct (Llamafied)

An approximate conversion of Apriel 5B Instruct to the Llama format.

  • —No trust_remote_code required
  • —Compatible w/ popular fine-tuning frameworks
  • —Easier to run

Usage:

python
from transformers import pipeline
import torch

device = 'cuda' if torch.cuda.is_available() else 'mps' if torch.backends.mps.is_available() else 'cpu'

pipe = pipeline('text-generation', model='mrfakename/Apriel-5B-Instruct-llamafied', device=device)

print(pipe(pipe.tokenizer.apply_chat_template([{'role': 'user', 'content': 'Hello'}], tokenize=False, add_generation_prompt=True))[0]['generated_text'])

License: MIT (same as the original Apriel 5B model)