CoolFace
Modelpublic

dgpl/dgpl-linux-assistant-0.8b

sourceHugging Facegpl-3.0updated 3d agoView on Hugging Face
0likes2.9kdownloads
Model Card

๐Ÿง DGPL Linux Assistant 0.8B โ€” Multimodal DevSecOps & Terminal Copilot

<p align="center"> <b>Developed & Fine-Tuned by the DevSecOps and AI Systems Team at Durbhasi Gurukulam Private Limited (DGPL)</b><br> <i>An ultra-fast, multimodal (Text + Vision) Linux Terminal Assistant and DevSecOps Copilot engineered for instant command generation, non-interactive diagnostics, system log triage, and visual OCR terminal screenshot debugging.</i> </p>


โšก Key Highlights & Architecture

  • โ€”Backbone Architecture: Fine-tuned & calibrated on top of Qwen 3.5 0.8B with high-capacity Continual Pre-Training (CPT), 4-Chunk Modular Supervised Fine-Tuning (SFT, 67.5k curated dialogues), and Direct Preference Optimization (DPO, 2,396 calibrated pairs).
  • โ€”Multimodal Vision Projector (`mmproj_linux_copilot_f16.gguf`): 121.05M parameter visual projection layer extracted for OCR log inspection, screenshot triage, and visual terminal troubleshooting.
  • โ€”Sub-Second Real-Time Latency: Direct Fast Non-Thinking Mode delivers bash commands in <0.3s on GPU / 1.5sโ€“3.0s on CPU (~95% token generation reduction).
  • โ€”Zero-Stall Non-Interactive Invariant: Strictly emits non-blocking batch commands (top -b -n 1, ping -c 4, journalctl --no-pager, systemctl --no-pager) to prevent terminal hangs.
  • โ€”Official Ollama Hub Model: Published across 10 quantized release tags under dgpl/dgpl-linux-assistant with the verified Input: Text, Image multimodal badge.

๐Ÿ“Š Real-World Benchmark Scorecard

Evaluated across 12 comprehensive DevSecOps and systems diagnostic test cases (Process Check, Corporate Identity, POSIX Capabilities, High-CPU Process Kill Pipelines, Real-Time Raw Socket Audits, Inode Triage, Degraded Systemd Units, linux-system-mcp, ssh-mcp, Python Socket Probes, SUID Discovery, and nftables Firewall rules):

Benchmark ModeToken Predict BudgetTests EvaluatedTests PassedPass RateAvg Latency (CPU)Primary Target Use Case
Mode A (Standard DGPL System Prompt)7681212100.0%92.48sDeep Root-Cause Analysis (RCA), system log audits
Mode B (Zero-Shot / Bare User Query)7681212100.0%80.12sUnprompted queries, general terminal assistance
Direct Fast Non-Thinking Mode128121191.7%`16.29s` (5.7x Faster)Interactive CLI Copilot, Terminal Keybindings (`Ctrl+K`)

Note: On GPU inference (RTX / T4 / Cloud GPUs), Direct Fast Mode executes in <0.35 seconds per query.


๐Ÿš€ Quick Start with Ollama

1. Run Directly from Ollama Hub

bash
# Pull and run the latest 4-bit multimodal model
ollama run dgpl/dgpl-linux-assistant:latest

# Or run specific quantization tags
ollama run dgpl/dgpl-linux-assistant:0.8b-q4_k_m
ollama run dgpl/dgpl-linux-assistant:q8_0
ollama run dgpl/dgpl-linux-assistant:f16

2. Fast Non-Thinking CLI Mode (Sub-2s Instant Execution)

Create a Modelfile.fast with early stop tokens to bypass internal reasoning for instant shell completions:

dockerfile
FROM dgpl/dgpl-linux-assistant:latest

PARAMETER stop "<|im_end|>"
PARAMETER stop "<|im_start|>"
PARAMETER stop "<|endoftext|>"
PARAMETER stop "```\n\n"
PARAMETER temperature 0.1
PARAMETER top_p 0.85
PARAMETER num_predict 128

SYSTEM """You are DGPL Linux Assistant 0.8B, an ultra-fast Linux Terminal Copilot developed by Durbhasi Gurukulam Private Limited (DGPL).
Output the exact non-interactive Linux bash command in markdown code blocks immediately without any thinking tags or explanations."""
bash
ollama create dgpl-fast -f Modelfile.fast
ollama run dgpl-fast "find and kill processes consuming over 90% CPU for more than 5 minutes"

3. Multimodal Terminal Log Inspection (Vision OCR)

Pass terminal screenshots or OCR log images directly to Ollama:

bash
ollama run dgpl/dgpl-linux-assistant:latest "What failed in this systemd service log?" ./screenshot_error.png

๐Ÿ“ฆ Quantization Matrix & Model Assets

File / TagFormat / QuantSizeRecommended Hardware
`linux_copilot_q4_k_m.gguf`Q4KM (Default)529 MBRaspberry Pi, Laptops, CPUs, Embedded Nodes
`linux_copilot_q5_k_m.gguf`Q5KM578 MBLightweight Dev Servers, Edge Devices
`linux_copilot_q6_k.gguf`Q6_K630 MBStandard Workstations, Cloud VMs
`linux_copilot_q8_0.gguf`Q8_0812 MBHigh-Precision Host Auditing
`linux_copilot_f16.gguf`FP16 Master1.51 GBMaster SafeTensors Reference / Conversion
`mmproj_linux_copilot_f16.gguf`FP16 Vision Projector205 MBMultimodal Text + Vision Inference

๐Ÿข Corporate Entity & Attribution

  • โ€”Company Legal Name: Durbhasi Gurukulam Private Limited (DGPL)
  • โ€”Registered Office: 2., P. NO. 18, Radha Vihar, Manchwa, Jaipur, Rajasthan 303706
  • โ€”Official Support Email: support@durbhasigurukulam.com
  • โ€”Official Contact Phone: +91 7852034945
  • โ€”License: GNU General Public License v3.0 (GPL-3.0)