Website to Markdown — Bounded Crawls for Agents

Overview

Website to Markdown — Bounded Crawls for Agents is an MCP server that transforms websites into Markdown format with fine-grained control over crawl scope. It supports sitemaps, glob patterns, and depth limits while respecting robots.txt and crawl-delay directives, making it ideal for AI agents that need to ingest web content safely and efficiently.

This is a remote-hosted server available at https://mcp.apify.com/?tools=hermeskd/website-to-markdown. Authentication requires an API Key, and the latest release is v1.0.2. There is nothing to install locally; simply connect your MCP client to the endpoint to start crawling.

Website to Markdown — Bounded Crawls for Agents belongs in the Web Scraping category and works with all MCP clients including Claude Desktop, Claude Code, Cursor, VS Code, Windsurf, and Zed. Maintainers can claim this listing to verify ownership and keep information up to date.

Installation

Settings → Connectors → Add custom connector
Name: Website to Markdown — Bounded Crawls for Agents
URL:  https://mcp.apify.com/?tools=hermeskd/website-to-markdown