Robots Sitemap Validator

1---
2name: robots-sitemap-validator
3description: Check robots.txt and sitemap.xml for crawl-blocking mistakes. Use when the user says "check my robots.txt", "validate my sitemap", or "is my site crawlable".
4metadata:
5  author: JustHandled Labs
6  version: 1.0.0
7  price: $0
8  credits: 0
9  triggers:
10    - check my robots.txt
11    - validate my sitemap
12    - is my site crawlable
13---
14 
15# Robots Sitemap Validator
16 
17Detect common local robots.txt and sitemap.xml mistakes that can hurt crawling. This detector does not fetch, submit, or change live sites.
18 
19## Workflow
20 
211. Run scripts/scan_robots_sitemap.py with a folder, files, or --stdin.
222. Review findings by rule id, severity, file, and line.
233. Treat missing sibling sitemap files as review flags when robots.txt references them.
24 
25## Guardrails
26 
27- Read local files or stdin only.
28- Do not fetch live URLs or submit sitemaps.
29- Do not modify robots.txt or sitemap files.
30 
31## Verification
32 
33Run tests/test_robots_sitemap.py. Risky fixture must produce findings and clean fixture must produce zero findings.
34 
35## Commercial Terms
36 
37Price: $0 / 0 credits. Free commercial use for personal or internal team workflows. Do not resell or redistribute the package as-is.
38