Back to Browse

Modelwatch MCP Server

Developer ToolsUse Caution4.2MCP RegistryLocal
Free

Server data from the Official MCP Registry

Continuous behavioral drift monitoring for LLM apps — catches silent provider model updates.

About

Continuous behavioral drift monitoring for LLM apps — catches silent provider model updates.

Security Report

4.2
Use Caution4.2High Risk

The ModelWatch MCP server is a legitimate drift-monitoring tool with appropriate authentication and reasonable permissions for its purpose. However, the codebase contains several moderate-severity concerns: API keys are passed through environment variables without explicit validation or warnings, the frontend stores API keys in localStorage (persistent across sessions) which increases exfiltration surface, and the weekly drift report script makes unauthenticated calls to multiple LLM providers. These issues do not indicate malicious intent but represent real security practices that users should understand. Supply chain analysis found 12 known vulnerabilities in dependencies (0 critical, 6 high severity). Package verification found 1 issue.

6 files analyzed · 21 issues found

Security scores are indicators to help you make informed decisions, not guarantees. Always review permissions before connecting any MCP server.

Permissions Required

This plugin requests these system permissions. Most are normal for its category.

env_vars

Check that this permission is expected for this type of plugin.

HTTP Network Access

Connects to external APIs or services over the internet.

File System Read

Reads files on your machine. Normal for tools that analyze or process local data.

File System Write

Writes or modifies files on your machine. Check that this is expected for the tool.

What You'll Need

Set these up before or after installing:

API key from https://modelwatch.app (free tier: 5 specs, 500 runs/mo).Required

Environment variable: MODELWATCH_API_KEY

Override the API base URL for self-hosted deployments.Optional

Environment variable: MODELWATCH_API_BASE

How to Install

Add this to your MCP configuration file:

{
  "mcpServers": {
    "io-github-bch1212-modelwatch": {
      "env": {
        "MODELWATCH_API_KEY": "your-modelwatch-api-key-here",
        "MODELWATCH_API_BASE": "your-modelwatch-api-base-here"
      },
      "args": [
        "-y",
        "modelwatch-mcp"
      ],
      "command": "npx"
    }
  }
}

Reviews

No reviews yet

Be the first to review this server!