NEWFree AI visibility report. Monitoring from $125/month

The Crawler Question

Five distinct jobs AI bots do on your site, the blocking policy that follows from each, and how to read your own logs to see who is already there.

4 pagesPDFJuly 2026
Scout the hawk lifting the corner of a paper sheet

What's inside

  • The five bot jobs: training, retrieval, actioning, indexing, verification
  • A blocking policy per job, not per vendor
  • How to read your server logs and identify each visitor
  • What blocking actually costs you in AI answers

Get the paper

Free download, no card. We will not share your email.

A cream felt document pressed with an indigo wax seal

Now see it for your brand.

The paper explains the mechanism. Your free report shows where your brand falls out of it.

Start free

Free AI visibility report · No credit card · Cancel anytime · 50 prompts, 8 engines