    servers/
        finance/
        robots-txt-checker
  

RT

Robots Txt Checker

Unverified Claim & verify → Finance

Checks if a URL path is allowed by robots.txt. x402 payment required (testnet USDC).

Try Remote Server

Overview Installation

Overview

Robots Txt Checker is a Model Context Protocol server that verifies whether a URL path is allowed by robots.txt rules. It requires x402 payment in testnet USDC to operate. By implementing MCP, this tool integrates directly with AI assistants as callable functions, eliminating manual workflows between separate applications.

The server runs as a remote, hosted endpoint at https://faceted-napped-debtless.ngrok-free.dev/robots-txt-checker/mcp with no local installation or authentication required. The latest release is v1.0.93057.

Robots Txt Checker is listed in the Finance category on mcp.site and works with any MCP client, including Claude Desktop, Claude Code, Cursor, VS Code, Windsurf, and Zed. If you maintain this server, you can claim this listing to verify ownership and keep information up to date.

▸Hosted endpoint — Streamable HTTP · https://faceted-napped-debtless.ngrok-free.dev/robots-txt-checker/mcp

Installation

Settings → Connectors → Add custom connector
Name: Robots Txt Checker
URL:  https://faceted-napped-debtless.ngrok-free.dev/robots-txt-checker/mcp

Related servers

WO

WooCommerce Orders

GetMCP Finance Remote

Query orders, customers, and products from your WooCommerce store.

          ★ 256
        Hosted · OAuth
    →
  

PI

Propick Integration MCP

Finance Remote

Manage your real-estate stock on Propick (Dubai): bulk listing sync, lookups and run reports.

        Added 1 month ago
    →
  

PU

PuroAir

Finance Remote

Breathe with Confidence. Live MCP catalog for PuroAir HEPA air purifiers - stock, pricing, details.

        Added 1 month ago
    →
  

BA

Baselight

Finance Remote

Query Baselight's public catalog of 70,000+ datasets — finance, demographics, sports, and more.

        Added 1 month ago
    →
  

CC

Constellation Credit

Finance Remote

Financial and covenant data for public and private credit: statements, cap stacks, covenants.

        Added 1 month ago
    →
  

CL

Crane Ledger

Finance Remote

Headless API-first double-entry accounting & bookkeeping engine. 84 MCP tools over HTTP.

        Added 1 month ago
    →
  