    servers/
        development/
        robotstxt-policy-lint
  

RP

Robots.txt Policy Lint

Unverified Claim & verify → Development

{"jsonrpc":"2.0","id":1,"method":"tools/call","params":{"name":"whoami","arguments":{}}} free no key.

Visit website ↗ Try Remote Server

Overview Installation

Overview

Robots.txt Policy Lint is an MCP server that validates and analyzes robots.txt files for policy compliance and best practices. It helps developers catch configuration errors and ensure search engine crawlers follow intended directives. Available free with no authentication required, it integrates seamlessly into your workflow through the Model Context Protocol.

The server runs as a remote endpoint at https://www.pathwren.workers.dev/c/mcp-registry-official/mcp/robots, requiring no local installation or setup. Current version is v1.4.0. Simply connect your MCP client to get started with instant access to robots.txt linting capabilities.

Robots.txt Policy Lint is listed in the Development category on mcp.site and works with all MCP clients including Claude Desktop, Claude Code, Cursor, VS Code, Windsurf, and Zed. If you maintain this server, claim your listing to verify ownership and keep information up to date.

▸Hosted endpoint — Streamable HTTP · https://www.pathwren.workers.dev/c/mcp-registry-official/mcp/robots

Installation

Settings → Connectors → Add custom connector
Name: Robots.txt Policy Lint
URL:  https://www.pathwren.workers.dev/c/mcp-registry-official/mcp/robots

Related servers

CO

Context7

Development Remote

Up-to-date, version-specific library documentation and code examples inside AI coding prompts.

          ★ 18.2k
        Updated 1d ago
    →
  

TE

Termany

Development

A safe, sandboxed terminal your agent can actually use.

          ★ 174
        Added 5 days ago
    →
  

LO

LocalCan

Development

Expose local dev servers with public URLs from MCP clients.

          ★ 82
        Added 4 days ago
    →
  

SM

SSH MCP Server

Development

Run commands on remote machines over SSH from MCP clients.

          ★ 38
        Added 12 hours ago
    →
  

HN

hood. — .hood name service

Development Remote

Resolve .hood names on Robinhood Chain — forward/reverse, text records, availability & pricing.

        Added 1 month ago
    →
  

ID

Ideation

Development Remote

Actwise Ideation helps founders benchmark startup and product ideas before they build.

        Added 1 month ago
    →
  