Modelpublic

LocalAI-io/Mirai-Nova-Llama3-LocalAI-8B-v0.1

sourceHugging Facellama3updated 2y agoView on Hugging Face

1likes20downloads

Model Card

image/png

Mirai Nova: "Mirai" means future in Japanese, and "Nova" references a star showing a sudden large increase in brightness.

A set of models oriented in function calling, but generalist and with enhanced reasoning capability. This is fine tuned with Llama3.

Mirai Nova works particularly well with LocalAI, leveraging the function call with grammars feature out of the box.

GGUF quants: https://huggingface.co/mudler/Mirai-Nova-Llama3-LocalAI-8B-v0.1-GGUF

OpenVINO: https://huggingface.co/fakezeta/Mirai-Nova-Llama3-LocalAI-8B-v0.1-ov-int8

To run on LocalAI:

local-ai run huggingface://mudler/Mirai-Nova-Llama3-LocalAI-8B-v0.1-GGUF/localai.yaml