duyntnet/Virtuoso-Small-imatrix-GGUF

Quantizations of https://huggingface.co/arcee-ai/Virtuoso-Small

Inference Clients/UIs

• —llama.cpp
• —KoboldCPP
• —ollama
• —jan
• —text-generation-webui
• —GPT4All ---

From original readme

Virtuoso-Small is the debut public release of the Virtuoso series of models by Arcee.ai, designed to bring cutting-edge generative AI capabilities to organizations and developers in a compact, efficient form. With 14 billion parameters, Virtuoso-Small is an accessible entry point for high-quality instruction-following, complex reasoning, and business-oriented generative AI tasks. Its larger siblings, Virtuoso-Medium and Virtuoso-Large, offer even greater capabilities and are available via API at models.arcee.ai.

Key Features

• —Compact and Efficient: With 14 billion parameters, Virtuoso-Small provides a high-performance solution optimized for smaller hardware configurations without sacrificing quality.
• —Business-Oriented: Tailored for use cases such as customer support, content creation, and technical assistance, Virtuoso-Small meets the demands of modern enterprises.
• —Scalable Ecosystem: Part of the Virtuoso series, Virtuoso-Small is fully interoperable with its larger siblings, Forte and Prime, enabling seamless scaling as your needs grow.