# Agent readiness tools: 7 checkers and a robots.txt generator

> Check llms.txt, MCP, WebMCP, OpenAPI, caching, and markdown the way agents read them, or build robots.txt lines for AI crawlers. Each checker runs a full scan.

- Source: /tools
- Site: AgenticWebScore
- Language: English

---
Each checker here runs the full scan, and the report opens on the checks it names. The generator writes robots.txt lines and sends no request.

## Crawlers and files

- [llms.txt checker](/tools/llms-txt-checker): Check /llms.txt and /llms-full.txt the way an agent reads them. Each result shows its evidence, any change to make, and a command that repeats it. Checks: `llms-txt` and `llms-full`.
- [AI crawler checker](/tools/ai-crawler-checker): See which AI crawlers your robots.txt names, what it allows each one, and whether it states Content-Signal preferences. Each result shows its evidence. Checks: `ai-rules`, `robots-txt`, `content-signal`, and `reachable`.
- [AI robots.txt generator](/tools/ai-robots-txt-generator): Build robots.txt lines that block AI crawlers by purpose: training, search, or fetches a user asks for. It sends no request, and allowed crawlers stay unnamed.

## Agent interfaces

- [MCP server tester](/tools/mcp-server-tester): Find the MCP server your site names and open one session with it. The scan sends initialize and tools/list, calls no tool, and shows the tools it lists. Checks: `mcp-server` and `mcp-card`.
- [WebMCP checker](/tools/webmcp-checker): Find the WebMCP tools your homepage declares: registerTool() calls and forms with a toolname. The scan reads the HTML it is served and runs no JavaScript. Checks: `webmcp`.
- [OpenAPI checker](/tools/openapi-checker): Find the OpenAPI document, API catalog, docs, and OAuth metadata a site publishes, and check each one. It reads what the site serves, not a pasted file. Checks: `openapi`, `api-catalog`, `docs`, and `oauth-discovery`.

## HTTP

- [Markdown for agents checker](/tools/markdown-for-agents-checker): Ask your homepage for markdown the way a coding agent does, and see the type and Vary header it answers with. Each result shows its evidence. Checks: `markdown-negotiation`.
- [HTTP cache checker](/tools/http-cache-checker): Test the cache headers of your homepage and whether it answers a validator with 304. See what a missing page answers to a browser and to a JSON client. Checks: `http-caching`, `not-found-status`, and `structured-errors`.

Every checker sends the scan the [scan form](/scan) sends, with the same limits. [The 60 checks](/checks) lists the rest of the rubric.