servers/ web-scraping/ actablesite-ai-crawler-monitor
ActableSite AI Crawler Monitor icon

ActableSite AI Crawler Monitor

Unverified Claim & verify → Web Scraping

Check AI crawler robots.txt policy and monitor public-site policy, sitemap, and llms.txt changes.

Visit website ↗ View on GitHub ↗ Try Remote Server
Overview Installation

Overview

ActableSite AI Crawler Monitor is a Model Context Protocol (MCP) server: Check AI crawler robots.txt policy and monitor public-site policy, sitemap, and llms.txt changes. Because it speaks the Model Context Protocol, AI assistants can use ActableSite AI Crawler Monitor as a set of callable tools instead of you copy-pasting between apps.

It's a hosted (remote) server — point your client at https://actablesite.com/mcp/ and you're connected, with nothing to install locally. The current release is v1.4.2, published under the MIT license, with source at unitedideas/actablesite-mcp on GitHub.

On mcp.site, ActableSite AI Crawler Monitor sits in the Web Scraping category. Any MCP client can use it — Claude Desktop, Claude Code, Cursor, VS Code, Windsurf, Zed among them — via the install snippets below. If you maintain ActableSite AI Crawler Monitor for actablesite.com, claim this listing to verify ownership, earn the Verified badge, and keep the details current.

Hosted endpoint — Streamable HTTP · https://actablesite.com/mcp/
Open source — MIT license · unitedideas/actablesite-mcp
Topics — aeo, ai-agent, ai-crawlers, ai-tools, chatgpt

Installation

Settings → Connectors → Add custom connector
Name: ActableSite AI Crawler Monitor
URL:  https://actablesite.com/mcp/

Related servers

PM
Playwright MCP
Web Scraping

Browser automation, page inspection, screenshots, and web interaction from Claude, Cursor, and other AI agents.

★ 21.3k Updated 5h ago
FM
Firecrawl MCP
Web Scraping

Powerful web scraping and search capabilities for LLM clients like Cursor and Claude.

★ 12.4k Updated 3h ago
BM
BitBrowser MCP
Web Scraping

Control BitBrowser profiles and automate multi-account flows.

Added 23 hours ago
Gatetest icon
Gatetest
Web Scraping

120-module QA gate. Give Claude eyes (screenshots), ears (Sentry errors), and hands (verify fixes).

Added 2 hours ago
Nimrod Research icon
Nimrod Research
Web Scraping

Web research for agents: quality-scored Google search, webpage extraction, and deep research.

★ 256 Added 2 hours ago
SH
Shiplight
Web Scraping

An MCP server that provides browser automation.

Added 2 hours ago
>_ esc
↑↓ navigate↵ openesc close