AgentReadyAI visibilityCaffeine & CommerceShopify agency
AgentReady

Glossary

AI crawlers (GPTBot, ClaudeBot, PerplexityBot)

AI crawlers are the bots that retrieve web content for AI assistants — GPTBot (OpenAI), ClaudeBot (Anthropic), PerplexityBot (Perplexity), Google-Extended, and others.

Your robots.txt decides whether they can read your store. Blocking them keeps you out of AI answers; explicitly allowing them is how you opt into the channel.

Measuring AI-agent traffic to your store