AgiloopAppReadinessBot
If you see this name in your logs, someone asked AppReadiness.ai for a free check of your site. The bot fetched public pages of your site to run that check.
What it does
A person enters a web address on AppReadiness.ai. The bot then loads that page and some of the pages it links to, the way a visitor's browser would, and reads your robots.txt, sitemap and llms.txt. It looks at security headers, speed, search and AI visibility, and basic accessibility, and turns that into a score for the person who asked.
Its User-Agent header is Mozilla/5.0 (compatible; AgiloopAppReadinessBot/1.0; +https://appreadiness.ai/bot). In robots.txt, its name is AgiloopAppReadinessBot. It doesn't sign in, submit forms or try to get past anything.
Limits
- Your site only. That includes its www or non-www version if your address redirects there.
- At most 25 pages per check, including the first one.
- At most 5 links deep from the first page.
- One scan per request. It runs when someone asks for a check, not on a schedule.
- Public pages only.
- One request at a time, at least a second apart.
robots.txt
The bot follows your robots.txt. It uses the rules for AgiloopAppReadinessBot if you have any, and the rules for * if not.
How to block it
Add this to your robots.txt:
User-agent: AgiloopAppReadinessBot Disallow: /
With this rule the bot follows no links on your site. It still loads the one page a person asked about, because that is the check they requested.
Contact
Questions about the bot, or a problem with how it crawled your site? Email us at [email protected].