fcampanini74/mem-agent-4B-Q4-K-M-GGUF

mem-agent 4B - Q4KM GGUF

This is a 4-bit GGUF quantization of driaforall/mem-agent, a persistent memory agent trained with online RL.

Model Description

mem-agent is a 4B parameter language model based on Qwen3-4B-Thinking-2507, trained using GSPO (Generalized Supervised Policy Optimization) to interact with a markdown-based memory system inspired by Obsidian.

This GGUF conversion enables:

• —✅ LM Studio compatibility - Run the model locally with an intuitive GUI
• —✅ Windows support - Part of a broader mem-agent Windows porting project
• —✅ CPU/GPU inference - Optimized for various hardware configurations
• —✅ Reduced memory footprint - ~2GB model size with minimal performance loss

Original Model

The original model was developed by driaforall and achieves impressive results:

• —75% overall score on md-memory-bench
• —Rivals models 50x its size on memory tasks
• —Trained on three core capabilities: Retrieval, Updating, and Clarification

Read the full technical blog post: mem-agent: Persistent, Human Readable Memory Agent

Quantization Details

• —Format: GGUF (Q4KM)
• —Precision: 4-bit quantization
• —Size: ~2GB
• —Performance: Minimal degradation compared to full precision (original 4-bit MLX version: 76.8% overall score)

Why This Port?

The original mem-agent MCP server was designed for Mac and Linux environments. This GGUF conversion is part of a Windows porting project to make mem-agent accessible to a broader audience through:

• —LM Studio integration for easy local deployment
• —Cross-platform compatibility
• —Standard GGUF toolchain support (llama.cpp, Ollama, etc.)

🪟 Windows Port Project

This model is part of the Windows porting effort of mem-agent:

• —Repository: mem-agent-mcp-Windows
• —Goal: Enable mem-agent functionality on Windows systems
• —Integration: Compatible with LM Studio and other GGUF-based tools

Usage

LM Studio

1. 1.Download the GGUF file
2. 2.Load it in LM Studio
3. 3.Configure the model with appropriate system prompts for memory agent functionality

llama.cpp

./main -m mem-agent-4B-Q4-K-M.gguf -p "Your prompt here" -n 512