ApplauseLab/bankai-v1

bankai-v1

bankai-v1 is a one-step agent orchestration model based on `Qwen/Qwen3-Coder-Next`, trained to perform one-step agent orchestration. Given a task, it selects one specialist worker and emits a complete delegated instruction as strict JSON.

This repository includes the original MLX LoRA, a llama.cpp GGUF LoRA, a fully fused 4-bit MLX model, and a fully fused Q4KM GGUF model. The adapter was trained against `mlx-community/Qwen3-Coder-Next-4bit`. The upstream model is an 80B MoE with approximately 3B active parameters.

Model Details

Qwen3-Coder-Next has 48 layers, 512 routed experts, ten activated routed experts per token, and one shared expert. bankai-v1 adapts only attention and gated-delta projections in the final 16 layers; it does not add LoRA matrices to the routed experts.

Repository Contents

Output Contract

{
  "action": "call_agent",
  "agent": "software_engineer",
  "model": "auto",
  "instruction": "A complete execution-ready instruction for the worker",
  "context_refs": ["user_request"],
  "expected_output": "completed_task_with_evidence",
  "budget": {"max_tokens": 4096}
}

Supported worker labels:

• —software_engineer
• —technical_writer
• —marketing_strategist
• —marketing_copywriter
• —sales_specialist
• —customer_support_specialist
• —data_analyst
• —product_designer
• —financial_analyst
• —compliance_specialist

Usage

Download the exact system prompt:

hf download ApplauseLab/bankai-v1 bankai-system.txt --local-dir bankai-v1

Fused MLX Model

The fused MLX model does not require an adapter:

hf download ApplauseLab/bankai-v1 \
  --include "mlx/*" \
  --local-dir bankai-v1

mlx_lm.generate \
  --model bankai-v1/mlx \
  --system-prompt "$(cat bankai-v1/bankai-system.txt)" \
  --prompt "Design a GDPR-compliant CRM integration for a real-estate business." \
  --max-tokens 1024 \
  --temp 0

MLX Adapter

Install MLX LM on Apple Silicon:

pip install "mlx-lm>=0.31.3" "huggingface-hub>=1.17"
hf download ApplauseLab/bankai-v1 \
  --include "adapter*" \
  --local-dir bankai-v1-adapter

Generate with the adapter:

mlx_lm.generate \
  --model mlx-community/Qwen3-Coder-Next-4bit \
  --adapter-path bankai-v1-adapter \
  --system-prompt "$(cat bankai-system.txt)" \
  --prompt "Design and test a GDPR-compliant CRM integration for a real-estate business." \
  --max-tokens 1024 \
  --temp 0

For best consistency, use the included bankai-system.txt.

Fused GGUF / llama.cpp

The fused GGUF is standalone and does not require --lora:

hf download ApplauseLab/bankai-v1 \
  gguf/bankai-v1-Q4_K_M.gguf \
  --local-dir bankai-v1

llama-cli \
  --model bankai-v1/gguf/bankai-v1-Q4_K_M.gguf \
  --system-prompt-file bankai-v1/bankai-system.txt \
  --prompt "Design a GDPR-compliant CRM integration for a real-estate business." \
  --temp 0 \
  --n-predict 1024 \
  --single-turn

GGUF Adapter

bankai-v1-f16.gguf is the same LoRA adapter converted for llama.cpp. It is not a standalone 80B model; load it alongside a compatible Qwen3-Coder-Next GGUF base:

llama-cli \
  --model Qwen3-Coder-Next-Q4_K_M.gguf \
  --lora bankai-v1/gguf/bankai-v1-f16.gguf \
  --system-prompt-file bankai-v1/bankai-system.txt \
  --prompt "Design a GDPR-compliant CRM integration for a real-estate business." \
  --temp 0 \
  --n-predict 1024

The GGUF adapter was converted through PEFT tensor orientation with lora_alpha=128, preserving the MLX effective scale of 16 at rank 8.

Use the included bankai-system.txt for the exact worker vocabulary and JSON contract seen during fine-tuning. Shorter prompts may produce valid routing in a different schema.

Fusion Details

The fused MLX model was produced by merging the LoRA into mlx-community/Qwen3-Coder-Next-4bit and saving the resulting quantized MLX weights.

The standalone GGUF starts from the single-file Unsloth Q4KM conversion of Qwen3-Coder-Next. Untouched tensors are copied bit-for-bit. The 64 targeted attention and gated-delta matrices in layers 32-47 are dequantized to F32, the LoRA delta is applied at effective scale 16, and each matrix is requantized to its original Q4KM mixture type. The resulting GGUF contains 843 tensors.

Training

• —Training base: mlx-community/Qwen3-Coder-Next-4bit
• —Upstream base: Qwen/Qwen3-Coder-Next
• —Method: MLX QLoRA
• —Trainable parameters: 2.857M, approximately 0.004%
• —Adapted blocks: final 16 of 48
• —Adapted modules: full-attention Q/K/V/O projections and gated-delta input/output projections
• —LoRA rank: 8
• —LoRA scale: 16
• —Optimizer: AdamW
• —Learning rate: 1e-5
• —Updates: 612
• —Gradient accumulation: 2
• —Maximum sequence length: 2048
• —Training tokens: 355,178
• —Peak training memory: 74.4 GB on an Apple M4 Max

The source consisted of 1,080 synthetic task-to-delegated-prompt examples across ten task categories and twenty industries. Grouped splitting held out complete industries and complete (category, subtask) groups:

• —Train: 612
• —Validation: 224
• —Test: 244

Only assistant tokens contributed to the loss.

Evaluation

• —Final sampled validation loss: 1.606
• —Held-out test loss over 32 batches: 1.795
• —Held-out test perplexity: 6.018
• —Behavioral evaluation: one held-out example from each of ten categories
• —Strict JSON validity: 10/10
• —Runtime schema validity: 10/10
• —Worker-routing accuracy: 10/10
• —Complete contract: 10/10

The behavioral sample is small and measures formatting and category routing, not end-to-end quality of worker execution.

Both fused formats received inference smoke tests with the full system prompt. The fused MLX output matched the JSON contract. The fused GGUF output also matched the contract, selected compliance_specialist for a held-out real-estate GDPR/CRM/accounting request, and generated at approximately 64 tokens/second on an Apple M4 Max using Metal offload.

Limitations

This first version learns only single-step worker selection and prompt delegation. It does not execute workers, consume observations, choose among specific model providers, verify results, retry failures, call agents in parallel, optimize cost, or perform reinforcement-learned multi-turn orchestration.

Training examples are synthetic and stylistically concentrated. Outputs may be overly verbose and domain-specific legal, financial, medical, or compliance instructions require qualified human review.

Intended Use

Use bankai-v1 as a routing and prompt-delegation component in an agent runtime that validates its JSON, resolves the selected worker, enforces budgets, and records real worker observations. Suitable initial domains include software delivery, documentation, marketing, customer support, analysis, product design, finance, and compliance workflows.

Do not treat generated delegated instructions as professional legal, regulatory, medical, accounting, or investment advice. The adapter should not be given authority to execute high-impact actions without runtime controls and human review.

Training Data Notes

The source is a synthetic Cartesian task grid rather than organic production traces. Inputs combine 54 task types with 20 industries. Responses are execution-ready delegated prompts averaging roughly 345 words. A grouped split was used instead of a random split to reduce leakage from repeated industry and subtask templates. No private user conversations were used.

The source artifact has a documented lineage discrepancy: records task-0881 through task-0900 differ from their current shard copies. Training used the checksummed final training_set.jsonl artifact.

Integrity

The fused GGUF also passed llama.cpp per-tensor hashing with whole-file XXH64 c64819733a364e4d.