ggml
Datasets
All datasets matching “ggml”ciggml-vicuna-v0-quantizedThese are quantized ggml binary files for vicuna 7B and 13B models. The version of vicuna for these models are v0.
These files can be used in conjunction with minigpt4 ggml models 7B and 13B in minigpt4.cpp
Recommended are the Q5_K and Q6_K implementations. If there are any issues, use Q4_1 or Q4_0.
Vicuna Model Card
Model details
Model type:
Vicuna is an open-source chatbot trained by fine-tuning LLaMA on user-shared conversations collected from ShareGPT.
It is… See the full description on the dataset page: https://huggingface.co/datasets/maknee/ggml-vicuna-v0-quantized.Supra2-100M-tokens-backup
Supra2-100M — pretraining token bins
DO NOT USE. Internal artifact of the Supra2-100M training run, published only
because public storage is free. These are raw uint16 token bins for one specific
tokenizer (supra2-tokenizer.json) and carry the licenses of their upstream sources
(FineWeb-Edu, DCLM, The Stack v3, FineMath, Cosmopedia, Wikipedia). No redistribution
rights are granted or implied. Files may be deleted at any time.
Layout: tokens_XXX.bin (4B tok each), val_000.bin… See the full description on the dataset page: https://huggingface.co/datasets/GGMLGuy/Supra2-100M-tokens-backup.ggml-japanese-gpt2Windowsの方はggml-japanese-gpt2の実行ファイルで動くと思います。
同じファイル名のggml形式のbinとSentencePiece形式のmodelをダウンロードして保存してください。
使い方は以下のようになります。
gpt-2.exe -m ggml-model-japanese-gpt2-medium-f16.bin -p "こんにちは"
ggml-model-japanese-gpt2-xsmallのファイル形式がおかしくなっているので、ダウンロードしても動きません。
あとで修正します。
minigpt4-7b-ggmlThese are quantized ggml binary files for minigpt4 7B model.
These files can be used in conjunction with vicuna v0 ggml models to get minigpt4 working.
Not all implementations were tested. If there are any issues, use f16.
minigpt4-13b-ggmlThese are quantized ggml binary files for minigpt4 13B model.
These files can be used in conjunction with vicuna v0 ggml models to get minigpt4 working.
Not all implementations were tested. If there are any issues, use f16.