Our crawler

AgentrixBot

If you found this page in your server logs: AgentrixBot read your site because someone asked Agentrix for a free health report of it. Here is what it does and how to stop it.

How to recognise it

Every request carries this User-Agent:

Mozilla/5.0 (compatible; AgentrixBot/1.0; +https://agentrix.website/bot)

It runs from Vultr's network, from a sandbox machine whose only way out is a proxy that allows the one site being read.

What it reads

• Public pages only, the ones anyone can open without signing in.
• More than that (a WordPress export, for example) only after the site's owner proves they control the domain, and only what the owner hands over.
• A capped number of pages for each health report.

How it behaves

• It follows robots.txt, including crawl-delay and noindex.
• One request at a time per site, at least half a second apart.
• It backs off when your server answers 429 or 503.
• It never sends forms, signs in or changes anything.
• Each request is recorded in the job's signed receipt.

How to stop it

Add this to your site's robots.txt, and AgentrixBot won't read any page:

User-agent: AgentrixBot
Disallow: /

To report a problem with it, write to Zavora Technologies through zavora.ai and include the time and the address it requested.