Shopify AI Readiness CheckerScan a store

About our crawler

If you found this page from a User-Agent string in your server logs, this explains what we were doing and how to stop us.

AIReadinessBot/0.1 (+https://aiready.pthreemedia.com/bot; scans public online stores on merchant request)

What this crawler does

Shopify AI Readiness Checker scores a public online store on how discoverable and usable it is for AI shopping agents. It reads public pages only: the same pages any shopper or search crawler can already request.

It never signs in, never submits a form, never adds to a cart, and never makes any change to a store.

To test a store's catalog search, it identifies itself with a UCP agent profile at https://aiready.pthreemedia.com/ucp/agent-profile.json. The profile declares catalog search and nothing else: no carts, checkouts or payments.

Why it visited your store

Every scan is started by a person typing a store URL into our site. There is no discovery crawl and no queue of sites we work through on our own: if we requested your pages, somebody asked us to, usually the merchant or someone evaluating the store.

Results are cached for 24 hours per store, so repeated requests for the same store in that window do not reach you at all.

How much traffic to expect

A scan is hard-capped at 80 requests and usually makes far fewer. That is the entire visit.

We make at most 4 requests at a time and leave at least 200 milliseconds between them, so a scan takes several seconds rather than arriving as a burst.

If your robots.txt sets a Crawl-delay we adopt it, up to 2 seconds. Beyond that we hold at 2 seconds rather than stretching one scan across several minutes, and a scan is a few dozen requests once rather than a continuous crawl.

We retry once, with backoff, and we honor Retry-After: if you ask for longer than 2 seconds we do not retry at all rather than come back early. Each refusal also doubles the gap we leave, up to 4 seconds. After 5 consecutive refusals we stop requesting your store altogether for the rest of the scan.

If your store rate limits or blocks us, the affected checks are reported as untested. A defensive response never makes a page or a policy look missing. The refusal itself is reported once, as what it is: a firewall that likely refuses AI shopping agents too, which is worth a merchant knowing.

If your firewall is blocking us

Some bot-management services decline any crawler they do not recognize. If a scan of your store reports checks as untested, this is the usual reason, and it is a setting on your side rather than a fault in either of us. A store that refuses us outright still gets a report: its robots.txt rules for AI crawlers, its llms.txt and Google’s speed data for it, with the firewall named where its responses carry the vendor’s marks.

Scans come from 152.55.177.27. Allow that address, or the user-agent AIReadinessBot/0.1, and the scan will complete.

We would rather you allowed us deliberately than that we arrived looking like something else. Our crawler never rotates addresses, disguises itself, or routes through residential proxies.

Separately, the person who asked for the scan may choose to read your store through their own browser. Their browser then fetches the same public pages, as any visit from them would, under the same request limits and the same robots.txt rule as our crawler. It never asks for account, cart or checkout pages, and discards one it is redirected to. That report opens by saying your firewall refused us, because AI agents that fetch from servers meet the same refusal.

How to block it

Add the following to your robots.txt and we will stop. We read robots.txt before anything else and respect it.

User-agent: AIReadinessBot
Disallow: /

Contact

Write to support@pthreemedia.com and we will answer.

If you would rather we never scanned your store and cannot edit your robots.txt, use the opt-out form at /opt-out. It takes effect immediately: there is no review queue.

Stop us scanning your store, read our privacy notice, or see exactly what we check.

About our crawler | Shopify AI Readiness Checker