Track AI crawlers and assistant referrals

The AI view shows crawl totals, bots, pages and a timeseries. Known hits map to Answers, Indexing, Training or Other. Inspect crawler 404s and popular pages with no recorded crawl.

The AI Assistants card lists human visits from ChatGPT, Perplexity, Claude, Gemini, Copilot and Grok. Compare them with goals and revenue on the same site. A referral is a human visit, not proof that an assistant cited you.

The AI view checks robots.txt, llms.txt and sitemap health, and gives a 0 to 100 visibility score. Indexing issues offer Fix with AI, which starts a thread with the affected URLs. You fix the site in its repository without exporting a crawler report.

1. Add the browser tag and one server or edge snippet for crawler hits; this needs Pro or a trial.
2. Open the Analytics AI view and review the four crawler buckets.
3. Inspect crawler 404s and popular pages with no recorded crawl.
4. Check discovery-file health for robots.txt, llms.txt and sitemaps.
5. Compare assistant referrals with goals and revenue.
6. Choose Fix with AI on an indexing issue and review the change.

• Crawler hits classified as Answers, Indexing, Training or Other.
• Assistant referrals beside goals and revenue, without treating them as citations.
• Discovery-file and indexing fixes made in the site's own repository.

See all workflows and guides.