gaianet/Phi-3-mini-4k-instruct-GGUF

<!-- header start --> <!-- 200823 --> <div style="width: auto; margin-left: auto; margin-right: auto"> <img src="https://github.com/GaiaNet-AI/.github/assets/45785633/d6976adc-f97d-4f86-a648-0f2f5c8e7eee" style="width: 100%; min-width: 400px; display: block; margin: auto;"> </div> <hr style="margin-top: 1.0em; margin-bottom: 1.0em;"> <!-- header end -->

Phi-3-mini-4k-instruct-GGUF

Original Model

microsoft/Phi-3-mini-4k-instruct

Run with Gaianet

Prompt template:

prompt template: phi-3-chat

Context size:

chatctxsize: 4000

Run with GaiaNet:

• —Quick start: https://docs.gaianet.ai/node-guide/quick-start

• —Customize your node: https://docs.gaianet.ai/node-guide/customize

Quantized with llama.cpp b3333