llms.txt Checker - AI Readiness Audit
Checks llms.txt, AI crawler access in robots.txt, and sitemap - with a 0-100 AI readiness score.
Install
Add this to your client's MCP configuration (Claude Desktop: claude_desktop_config.json; Cursor: .cursor/mcp.json; VS Code and others use the same "mcpServers" shape).
claude mcp add --transport http llms-txt-checker-ai-readiness-audit 'https://mcp.apify.com?tools=apifmcpfactory/llms-txt-checker' --header 'Authorization: <Apify API token as '\''Bearer <token>'\''. Optional if your MCP client supports OAuth.>'
{
"mcpServers": {
"llms-txt-checker-ai-readiness-audit": {
"type": "http",
"url": "https://mcp.apify.com?tools=apifmcpfactory/llms-txt-checker",
"headers": {
"Authorization": "<Apify API token as 'Bearer <token>'. Optional if your MCP client supports OAuth.>"
}
}
}
}
Documentation
From the project's README on GitHub, refreshed weekly. Links open on GitHub.
Contents
MCP Factory: pay-per-use MCP tools for AI agents
MCP Factory builds small, reliable, pay-per-use tools that AI agents can call over the Model Context Protocol (MCP). Each tool runs as an Apify Actor and is exposed through Apify's hosted MCP server — no installation, no infrastructure, no subscription. Your agent calls the tool directly; usage bills through your Apify account at flat, transparent per-result prices.
The tools
🔍 Tech Stack Detector
Find out what any website is built with. Scans a list of URLs and identifies the technologies behind each site — CMS, ecommerce platform, web frameworks, analytics, CDN, web server, and more — using the open-source webappanalyzer fingerprint dataset (7,500+ technologies across 109 categories). A fast, affordable Wappalyzer / BuiltWith alternative at roughly $5 per 1,000 sites.
- MCP server URL:
https://mcp.apify.com?tools=apifmcpfactory/tech-stack-detector - Apify Store: apify.com/apifmcpfactory/tech-stack-detector
- Try an example task: run it with sample input
- Details: tech-stack-detector/
🧾 EU VAT Validator
Validate EU VAT numbers in bulk against VIES, the European Commission's official VAT validation service — and get the official consultation number on every check as audit evidence for tax inspections. Bulk-safe with automatic retries, tolerant of messy input formats, $5 per 1,000 validations flat.
- MCP server URL:
https://mcp.apify.com?tools=apifmcpfactory/eu-vat-validator - Apify Store: apify.com/apifmcpfactory/eu-vat-validator
- Try an example task: run it with sample input
- Details: eu-vat-validator/
🤖 llms.txt Checker
A complete AI readiness audit for any website in one pass: checks llms.txt, llms-full.txt, robots.txt AI-crawler policy (GPTBot, ClaudeBot, PerplexityBot, Google-Extended, CCBot, Bytespider), and sitemap.xml, then returns a 0–100 AI readiness score with a plain-English list of exactly what to fix. ~$5 per 1,000 sites.
- MCP server URL:
https://mcp.apify.com?tools=apifmcpfactory/llms-txt-checker - Apify Store: apify.com/apifmcpfactory/llms-txt-checker
- Try an example task: run it with sample input
- Details: llms-txt-checker/
Connect all three tools at once
One MCP server URL exposes any combination of tools. To give your agent the full MCP Factory toolkit:
https://mcp.apify.com?tools=apifmcpfactory/tech-stack-detector,apifmcpfactory/eu-vat-validator,apifmcpfactory/llms-txt-checker
Claude Desktop (claude_desktop_config.json):
{
"mcpServers": {
"mcp-factory": {
"command": "npx",
"args": [
"mcp-remote",
"https://mcp.apify.com?tools=apifmcpfactory/tech-stack-detector,apifmcpfactory/eu-vat-validator,apifmcpfactory/llms-txt-checker",
"--header",
"Authorization: Bearer YOUR_APIFY_TOKEN"
]
}
}
}
Cursor (.cursor/mcp.json):
{
"mcpServers": {
"mcp-factory": {
"url": "https://mcp.apify.com?tools=apifmcpfactory/tech-stack-detector,apifmcpfactory/eu-vat-validator,apifmcpfactory/llms-txt-checker",
"headers": {
"Authorization": "Bearer YOUR_APIFY_TOKEN"
}
}
}
}
Replace YOUR_APIFY_TOKEN with your API token from Apify Console. New Apify accounts include free monthly usage credit, so you can try every tool before paying anything.
How pricing works
Every tool is pay-per-event: a small flat fee per run plus a flat fee per result. No subscriptions, no tiers, no minimums. Usage is billed through the Apify account whose token your agent uses — you can see every run, result, and charge in Apify Console.
About
MCP Factory publishes on the Apify platform as apifmcpfactory. Each tool is designed around the same principles: one clear job, bulk-safe execution (one output row per input, always), honest pricing, and output an AI agent can use without post-processing.
Frequently asked questions
What is llms.txt Checker - AI Readiness Audit?
Checks llms.txt, AI crawler access in robots.txt, and sitemap - with a 0-100 AI readiness score.
How do I install llms.txt Checker - AI Readiness Audit?
It runs as a remote server. In Claude Code: claude mcp add --transport http llms-txt-checker-ai-readiness-audit 'https://mcp.apify.com?tools=apifmcpfactory/llms-txt-checker' --header 'Authorization: <Apify API token as '\''Bearer <token>'\''. Optional if your MCP client supports OAuth.>'. For other clients, paste the JSON configuration from this page into their MCP settings.
Does llms.txt Checker - AI Readiness Audit need an API key?
Yes. It expects Authorization, which you set in its configuration.
Is llms.txt Checker - AI Readiness Audit open source?
Its code is public on GitHub, but the repository does not declare a standard license.
Who maintains llms.txt Checker - AI Readiness Audit?
It is published by apifymcpfactory-droid. AI.tn lists it but does not maintain or endorse it.
From the official MCP Registry. Listing is not an endorsement: review a server's code and permissions before giving it access to your data.