Validator
robots.txt parser
How scoring works
Stats
Our bot
robots.txt reports
f
firecrawl.dev
5 reports, newest first
Nov 1, 2026
https://www.firecrawl.dev/
Current
78 B
Oct 31, 2026
https://firecrawl.dev
Current
78 B
Oct 25, 2026
https://www.firecrawl.dev/
Outdated
78 B
Oct 14, 2026
https://www.firecrawl.dev/
Outdated
78 B
Oct 9, 2026
https://www.firecrawl.dev/
Outdated
78 B