servers/ web-scraping/ actablesite-ai-crawler-monitor
ActableSite AI Crawler Monitor icon

ActableSite AI Crawler Monitor

Unverified Claim & verify → Web Scraping

Check AI crawler robots.txt policy and monitor public-site policy, sitemap, and llms.txt changes.

Visit website ↗ View on GitHub ↗ Try Remote Server
Overview Installation

Overview

ActableSite AI Crawler Monitor is a Model Context Protocol (MCP) server: Check AI crawler robots.txt policy and monitor public-site policy, sitemap, and llms.txt changes. Because it speaks the Model Context Protocol, AI assistants can use ActableSite AI Crawler Monitor as a set of callable tools instead of you copy-pasting between apps.

It's a hosted (remote) server — point your client at https://actablesite.com/mcp/ and you're connected, with nothing to install locally. The current release is v1.4.2, published under the MIT license, with source at unitedideas/actablesite-mcp on GitHub.

On mcp.site, ActableSite AI Crawler Monitor sits in the Web Scraping category. Any MCP client can use it — Claude Desktop, Claude Code, Cursor, VS Code, Windsurf, Zed among them — via the install snippets below. If you maintain ActableSite AI Crawler Monitor for actablesite.com, claim this listing to verify ownership, earn the Verified badge, and keep the details current.

▸Hosted endpoint — Streamable HTTP · https://actablesite.com/mcp/
▸Open source — MIT license · unitedideas/actablesite-mcp
▸Topics — aeo, ai-agent, ai-crawlers, ai-tools, chatgpt

Installation

Settings → Connectors → Add custom connector
Name: ActableSite AI Crawler Monitor
URL:  https://actablesite.com/mcp/

Related servers

PM
Playwright MCP
Web Scraping

Browser automation, page inspection, screenshots, and web interaction from Claude, Cursor, and other AI agents.

★ 21.3k Updated 5h ago →
FM
Firecrawl MCP
Web Scraping Remote

Powerful web scraping and search capabilities for LLM clients like Cursor and Claude.

★ 12.4k Updated 3h ago →
BM
BitBrowser MCP
Web Scraping

Control BitBrowser profiles and automate multi-account flows.

Added 23 hours ago →
Gatetest icon
Gatetest
Web Scraping

120-module QA gate. Give Claude eyes (screenshots), ears (Sentry errors), and hands (verify fixes).

Added 1 month ago →
Nimrod Research icon
Nimrod Research
Web Scraping Remote

Web research for agents: quality-scored Google search, webpage extraction, and deep research.

★ 256 Added 1 month ago →
SH
Shiplight
Web Scraping

An MCP server that provides browser automation.

Added 1 month ago →
>_ esc
↑↓ navigate↵ openesc close