RichardErkhov/MaziyarPanahi_-_calme-2.4-rys-78b-gguf

Quantization made by Richard Erkhov.

Github

Discord

Request more models

calme-2.4-rys-78b - GGUF

• —Model creator: https://huggingface.co/MaziyarPanahi/
• —Original model: https://huggingface.co/MaziyarPanahi/calme-2.4-rys-78b/

Original model description: --- language:

• —en license: mit library_name: transformers tags:
• —chat
• —qwen
• —qwen2
• —finetune
• —chatml base_model: MaziyarPanahi/calme-2.1-rys-78b datasets:
• —MaziyarPanahi/truthy-dpo-v0.1-axolotl
• —Intel/orcadpopairs modelname: calme-2.4-rys-78b pipelinetag: text-generation inference: false modelcreator: MaziyarPanahi quantizedby: MaziyarPanahi model-index:
• —name: calme-2.4-rys-78b results:
• —task: type: text-generation name: Text Generation dataset: name: IFEval (0-Shot) type: HuggingFaceH4/ifeval args: numfewshot: 0 metrics:
• —type: instlevelstrictacc and promptlevelstrictacc value: 80.11 name: strict accuracy source: url: >- https://huggingface.co/spaces/open-llm-leaderboard/openllmleaderboard?query=MaziyarPanahi/calme-2.4-rys-78b name: Open LLM Leaderboard
• —task: type: text-generation name: Text Generation dataset: name: BBH (3-Shot) type: BBH args: numfewshot: 3 metrics:
• —type: accnorm value: 62.16 name: normalized accuracy source: url: >- https://huggingface.co/spaces/open-llm-leaderboard/openllm_leaderboard?query=MaziyarPanahi/calme-2.4-rys-78b name: Open LLM Leaderboard
• —task: type: text-generation name: Text Generation dataset: name: MATH Lvl 5 (4-Shot) type: hendrycks/competitionmath args: numfew_shot: 4 metrics:
• —type: exactmatch value: 37.69 name: exact match source: url: >- https://huggingface.co/spaces/open-llm-leaderboard/openllm_leaderboard?query=MaziyarPanahi/calme-2.4-rys-78b name: Open LLM Leaderboard
• —task: type: text-generation name: Text Generation dataset: name: GPQA (0-shot) type: Idavidrein/gpqa args: numfewshot: 0 metrics:
• —type: accnorm value: 20.36 name: accnorm source: url: >- https://huggingface.co/spaces/open-llm-leaderboard/openllmleaderboard?query=MaziyarPanahi/calme-2.4-rys-78b name: Open LLM Leaderboard
• —task: type: text-generation name: Text Generation dataset: name: MuSR (0-shot) type: TAUR-Lab/MuSR args: numfewshot: 0 metrics:
• —type: accnorm value: 34.57 name: accnorm source: url: >- https://huggingface.co/spaces/open-llm-leaderboard/openllmleaderboard?query=MaziyarPanahi/calme-2.4-rys-78b name: Open LLM Leaderboard
• —task: type: text-generation name: Text Generation dataset: name: MMLU-PRO (5-shot) type: TIGER-Lab/MMLU-Pro config: main split: test args: numfewshot: 5 metrics:
• —type: acc value: 66.69 name: accuracy source: url: >- https://huggingface.co/spaces/open-llm-leaderboard/openllmleaderboard?query=MaziyarPanahi/calme-2.4-rys-78b name: Open LLM Leaderboard ---

<img src="./calme-2.webp" alt="Calme-2 Models" width="800" style="margin-left:'auto' margin-right:'auto' display:'block'"/>

MaziyarPanahi/calme-2.4-rys-78b

This model is a fine-tuned version of the dnhkng/RYS-XLarge, pushing the boundaries of natural language understanding and generation even further. My goal was to create a versatile and robust model that excels across a wide range of benchmarks and real-world applications.

Use Cases

This model is suitable for a wide range of applications, including but not limited to:

• —Advanced question-answering systems
• —Intelligent chatbots and virtual assistants
• —Content generation and summarization
• —Code generation and analysis
• —Complex problem-solving and decision support

⚡ Quantized GGUF

Here are GGUF models thanks to @mradermacher:

• —https://huggingface.co/mradermacher/calme-2.4-rys-78b-GGUF
• —https://huggingface.co/mradermacher/calme-2.4-rys-78b-i1-GGUF

🏆 Open LLM Leaderboard Evaluation Results

Detailed results can be found here

Prompt Template

This model uses ChatML prompt template:

<|im_start|>system
{System}
<|im_end|>
<|im_start|>user
{User}
<|im_end|>
<|im_start|>assistant
{Assistant}

How to use

# Use a pipeline as a high-level helper

from transformers import pipeline

messages = [
    {"role": "user", "content": "Who are you?"},
]
pipe = pipeline("text-generation", model="MaziyarPanahi/calme-2.4-rys-78b")
pipe(messages)


# Load model directly

from transformers import AutoTokenizer, AutoModelForCausalLM

tokenizer = AutoTokenizer.from_pretrained("MaziyarPanahi/calme-2.4-rys-78b")
model = AutoModelForCausalLM.from_pretrained("MaziyarPanahi/calme-2.4-rys-78b")

Ethical Considerations

As with any large language model, users should be aware of potential biases and limitations. We recommend implementing appropriate safeguards and human oversight when deploying this model in production environments.