Server data from the Official MCP Registry
URL to clean markdown for LLMs: a polite, robots.txt-respecting web reader. Free, no API key
About
URL to clean markdown for LLMs: a polite, robots.txt-respecting web reader. Free, no API key
Remote endpoints: streamable-http: https://agent-web.foomworks.workers.dev/mcp
Security Report
Valid MCP server (1 strong, 1 medium validity signals). No known CVEs in dependencies. Imported from the Official MCP Registry. Trust signals: trusted author (3/3 approved). 1 finding(s) downgraded by scanner intelligence.
2 tools verified · Open access · 1 issue found
Security scores are indicators to help you make informed decisions, not guarantees. Always review permissions before connecting any MCP server.
Permissions Required
This plugin requests these system permissions. Most are normal for its category.
How to Connect
Remote Plugin
No local installation needed. Your AI client connects to the remote endpoint directly.
Add this to your MCP configuration to connect:
{
"mcpServers": {
"io-github-foomworks-agent-web": {
"url": "https://agent-web.foomworks.workers.dev/mcp"
}
}
}Documentation
View on GitHubFrom the project's GitHub README.
agent-web
URL → LLM-ready markdown. A charter-clean, polite, robots-respecting web reader for AI
agents — honors robots.txt, identifies honestly, and never bypasses anti-bot/CAPTCHA or
paywalls. No account, no API key — free per-call access.
🌐 Live: https://agent-web.foomworks.workers.dev · 🔌 MCP: https://agent-web.foomworks.workers.dev/mcp
What it gives an agent
Give it one publicly reachable URL; get back the page as clean, LLM-ready markdown — title, word count, and the text — without parsing raw HTML yourself. Server-rendered (static) HTML pages. Ideal for summarizing an article, extracting docs, or feeding a page into an LLM.
Connect as an MCP server (recommended)
Streamable HTTP, JSON-RPC 2.0:
https://agent-web.foomworks.workers.dev/mcp
| Tool | Cost | Returns |
|---|---|---|
read_url | free | fetch a URL → full LLM-ready markdown (title, word count, markdown) |
read_url_preview | free | the first ~600 characters of the markdown — a cheap look before the full pull |
Or call it over HTTP
BASE=https://agent-web.foomworks.workers.dev
curl -s "$BASE/read?url=https://example.com/&ref=readme" # full markdown
curl -s "$BASE/read/preview?url=https://example.com/&ref=readme" # first ~600 chars
Discovery: /.well-known/mcp.json (MCP) ·
/.well-known/agent-card.json (A2A) ·
/openapi.json ·
/policy (Acceptable-Use Policy)
Charter-clean by design (the bright line)
This is a polite reader, not a scraper:
- Honors the origin's
robots.txtfor our user-agent — a disallowed path is refused without fetching; an unconfirmablerobots.txt(5xx/error) is treated conservatively as disallowed. - Identifies honestly with a descriptive user-agent — never spoofs a browser.
- Read-only
GETof the single URL you supply — no crawl, no proxy rotation. - Never bypasses anti-bot/CAPTCHA, paywalls, or login walls.
- SSRF-guarded: private/loopback/link-local/internal hosts are blocked and every redirect hop is re-validated.
You are responsible for your right to fetch the URL you submit.
Limits
- Static HTML only for now — JavaScript-rendered pages, screenshots, and PDF are a later increment.
- Body cap ~2 MB, fetch timeout ~12 s.
- The service holds no keys and never initiates payments.
Install the AgentSkill
SKILL.md is a portable AgentSkill (ClawHub / skills.sh / Claude Skills).
About
agent-web is operated by FOOM — an AI-operated, human-supervised autonomous service. License: MIT.
Reviews
No reviews yet
Be the first to review this server!
More Developer Tools MCP Servers
Git
Freeby Modelcontextprotocol · Developer Tools
Read, search, and manipulate Git repositories programmatically
Toleno
Freeby Toleno · Developer Tools
Toleno Network MCP Server — Manage your Toleno mining account with Claude AI using natural language.
mcp-creator-python
Freeby mcp-marketplace · Developer Tools
Create, build, and publish Python MCP servers to PyPI — conversationally.
MarkItDown
Freeby Microsoft · Content & Media
Convert files (PDF, Word, Excel, images, audio) to Markdown for LLM consumption
MCP Marketplace
Freeby mcp-marketplace · Developer Tools
Search and install MCP servers from inside your AI client.
FinAgent
Freeby mcp-marketplace · Finance
Free stock data and market news for any MCP-compatible AI assistant.