Apppublic

dispatchAI/mcp-latency-estimator

sourceHugging Faceapache-2.0updated 3mo agoView on Hugging Face

0likes

App README

⚡ dispatchAI MCP Latency Estimator

MCP Server — estimate on-device inference latency for any mobile LLM.

—estimate_latency(params, quant, hardware, prompt_tokens, generate_tokens) — Get tokens/sec, RAM, and total time
—list_supported_hardware() — Browse supported hardware profiles

json

{
  "mcpServers": {
    "dispatchai-latency": {
      "url": "https://huggingface.co/spaces/dispatchAI/mcp-latency-estimator/mcp"
    }
  }
}

🚀 dispatchAI — Small. Mobile. Free. UAE-built.