RichardErkhov/oneonlee_-_LDCC-SOLAR-gugutypus-10.7B-gguf

Quantization made by Richard Erkhov.

Github

Discord

Request more models

LDCC-SOLAR-gugutypus-10.7B - GGUF

• —Model creator: https://huggingface.co/oneonlee/
• —Original model: https://huggingface.co/oneonlee/LDCC-SOLAR-gugutypus-10.7B/

Original model description: --- language:

• —en
• —ko license: cc-by-nc-4.0 datasets:
• —kyujinpy/KOR-gugugu-platypus-set base_model:
• —LDCC/LDCC-SOLAR-10.7B pipeline_tag: text-generation ---

LDCC-SOLAR-gugutypus-10.7B

<img src="logo.png" height=350, width=350>

Model Details

Model Developers

• —DongGeon Lee (oneonlee)

Model Architecture

• —LDCC-SOLAR-gugutypus-10.7B is a instruction fine-tuned auto-regressive language model, based on the SOLAR transformer architecture.

Base Model

• —LDCC/LDCC-SOLAR-10.7B

Training Dataset

• —kyujinpy/KOR-gugugu-platypus-set

Model comparisons

• —Ko-LLM leaderboard (2024/03/01) [[link]](https://huggingface.co/spaces/upstage/open-ko-llm-leaderboard)

<br>

• —(KOR) AI-Harness evaluation [[link]](https://github.com/Beomi/ko-lm-evaluation-harness)

<br>

• —(ENG) AI-Harness evaluation [[link]](https://github.com/EleutherAI/lm-evaluation-harness)

Implementation Code

### LDCC-SOLAR-gugutypus
from transformers import AutoModelForCausalLM, AutoTokenizer
import torch

repo = "oneonlee/LDCC-SOLAR-gugutypus-10.7B"
model = AutoModelForCausalLM.from_pretrained(
        repo,
        return_dict=True,
        torch_dtype=torch.float16,
        device_map='auto'
)
tokenizer = AutoTokenizer.from_pretrained(repo)