Can search engines and AI assistants read your site?

One line in a file most owners never open can shut them out. Ten seconds to find out.

Reads your robots.txt and homepage only. It can't see firewall rules, your other pages or your rankings.