CoolFace
Modelpublic

OrionStarAI/OrionStar-Yi-34B-Chat-Llama

sourceHugging Faceapache-2.0updated 2y agoView on Hugging Face
13likes103downloads
Model Card

OrionStarAI/OrionStar-Yi-34B-Chat-Llama

This model is identical to [OrionStarAI/OrionStar-Yi-34B](https://huggingface.co/OrionStarAI/OrionStar-Yi-34B/tree/main) with the only difference being that the tensors have been renamed to follow the LLaMA format for automatic evaluation on the HF leaderboard.

Model Introduction

  • —OrionStar-Yi-34B-Chat from OrionStarAI is based on the open-source Yi-34B model, fine-tuned on a high-quality corpus of over 15 million sentences. OrionStar-Yi-34B-Chat aims to provide an excellent interactive experience for users in the large model community.
  • —The Yi series models, open-sourced by the 01-ai team, have shown impressive performance on various benchmarks in Chinese, English, and general domains. OrionStar-Yi-34B-Chat further explores the potential of Yi-34B. Through extensive fine-tuning on a large and high-quality corpus, OrionStar-Yi-34B-Chat performs exceptionally well on evaluation data. We strive to make it an outstanding open-source alternative in the ChatGPT domain!
  • —Our fine-tuned model is completely open for academic research, but please adhere to the agreement and the Yi License.
  • —Model Evaluation Results

We use opencompass to perform 5-shot on the following general domain datasets Testing. The evaluation results of other models are taken from opencompass leaderboard.

C-EvalMMLUCMMLU
GPT-469.98371
ChatGPT52.569.153.9
Claude-15265.7-
TigerBot-70B-Chat-V257.765.959.9
WeMix-LLaMA2-70B55.271.356
LLaMA-2-70B-Chat44.363.843.3
Qwen-14B-Chat71.766.470
Baichuan2-13B-Chat56.75758.4
OrionStar-Yi-34B-Chat77.7178.3273.52

Discord Link: https://discord.gg/zumjDWgdAs