AI crawler checker
Every assistant sends a crawler to read a site before it will repeat anything from it. This reads your robots.txt (the file that tells automated visitors which pages they may read) and reports what it actually says.
This is 1 of 11 things we check.
See all of them