vicuna-v0
ggml-vicuna-v0-quantizedThese are quantized ggml binary files for vicuna 7B and 13B models. The version of vicuna for these models are v0.
These files can be used in conjunction with minigpt4 ggml models 7B and 13B in minigpt4.cpp
Recommended are the Q5_K and Q6_K implementations. If there are any issues, use Q4_1 or Q4_0.
Vicuna Model Card
Model details
Model type:
Vicuna is an open-source chatbot trained by fine-tuning LLaMA on user-shared conversations collected from ShareGPT.
It is… See the full description on the dataset page: https://huggingface.co/datasets/maknee/ggml-vicuna-v0-quantized.vicuna-v0-chatml
Dataset Card for "vicuna-v0-chatml"
More Information needed
vicuna-v0-lmgym
Dataset Card for "vicuna-v0-lmgym"
More Information needed