Crawlbit

Overview

Crawlbit is a Model Context Protocol server that provides four free tools for testing AI engine visibility and indexing of your site. It checks whether AI engines can find, read, and recognize your content without requiring an API key. Any MCP-compatible AI assistant can call these tools directly during conversations or agent runs.

The server runs locally via the npm package crawlbit-mcp, which communicates over stdio on your machine. No authentication or credentials are needed—it works immediately after installation. The latest release is v1.0.1 under the MIT license, with source code available at amati032-dev/crawlbit-mcp on GitHub.

Crawlbit is categorized as Development on mcp.site and works with all major MCP clients including Claude Desktop, Claude Code, Cursor, VS Code, Windsurf, and Zed. If you maintain this server, claim the listing to verify ownership, earn the Verified badge, and ensure the information stays accurate.

Installation

// claude_desktop_config.json
{
  "mcpServers": {
    "crawlbit": {
      "command": "npx",
      "args": [
        "-y",
        "crawlbit-mcp"
      ]
    }
  }
}