Server data from the Official MCP Registry
Evaluate RAG retrieval, agent tool calls and prompt regressions with deterministic metrics.
About
Evaluate RAG retrieval, agent tool calls and prompt regressions with deterministic metrics.
Security Report
Valid MCP server (2 strong, 3 medium validity signals). No known CVEs in dependencies. Package registry verified. Imported from the Official MCP Registry.
11 files analyzed · 1 issue found
Security scores are indicators to help you make informed decisions, not guarantees. Always review permissions before connecting any MCP server.
Permissions Required
This plugin requests these system permissions. Most are normal for its category.
What You'll Need
Set these up before or after installing:
Environment variable: EVALSMITH_JUDGE_BASE_URL
Environment variable: EVALSMITH_JUDGE_MODEL
Environment variable: EVALSMITH_JUDGE_API_KEY
Environment variable: LOG_LEVEL
How to Install
Add this to your MCP configuration file:
{
"mcpServers": {
"io-github-diegoperezg7-evalsmith-mcp": {
"env": {
"LOG_LEVEL": "your-log-level-here",
"EVALSMITH_JUDGE_MODEL": "your-evalsmith-judge-model-here",
"EVALSMITH_JUDGE_API_KEY": "your-evalsmith-judge-api-key-here",
"EVALSMITH_JUDGE_BASE_URL": "your-evalsmith-judge-base-url-here"
},
"args": [
"-y",
"evalsmith-mcp"
],
"command": "npx"
}
}
}Reviews
No reviews yet
Be the first to review this server!
More Developer Tools MCP Servers
Rea
Freeby Morluto · Developer Tools
Reverse engineer anything from your terminal or agent with one CLI and MCP server.
Paperclip
Freeby Paperclipai · Developer Tools
Trending hip-hop artist momentum scores across four cultural dimensions.
Git
Freeby Modelcontextprotocol · Developer Tools
Read, search, and manipulate Git repositories programmatically
Toleno
Freeby Toleno · Developer Tools
Toleno Network MCP Server — Manage your Toleno mining account with Claude AI using natural language.
MCP Marketplace
Freeby mcp-marketplace · Developer Tools
Search and install MCP servers from inside your AI client.
mcp-creator-python
Freeby mcp-marketplace · Developer Tools
Create, build, and publish Python MCP servers to PyPI — conversationally.