Modelpublic

Abhaykoul/HelpingAI-Lite-4x1b

sourceHugging Faceapache-2.0updated 3y agoView on Hugging Face

0likes76downloads

Model Card

HelpingAI-Lite-4x1b

Hey there! 👋 Welcome to the HelpingAI-Lite-4x1b! This is a MOE brought together using the awesome VortexMerge kit.

Let's see what we've got in this model:

—OEvortex/HelpingAI-unvelite 🚀
—OEvortex/lite-hermes 🚀
—OEvortex/HelpingAI-Lite 🚀
—OEvortex/HelpingAI-Lite-1.5T 🚀

🧩 Configuration

yaml

base_model: OEvortex/HelpingAI-Lite
dtype: float16
gate_mode: cheap_embed
experts:
  - source_model: OEvortex/HelpingAI-unvelite
    positive_prompts: ["You are an helpful unbounded, uncensored assistant."]
  - source_model: OEvortex/lite-hermes
    positive_prompts: ["You are helpful assistant."]
  - source_model: OEvortex/HelpingAI-Lite
    positive_prompts: ["You are a coding assistant."]
  - source_model: OEvortex/HelpingAI-Lite-1.5T
    positive_prompts: ["You are helpful and general-purpose assistant."]