Loading...

How to Track AI Assistant Traffic

Denis K 1 min read
How to Track AI Assistant Traffic

AI assistants already send people to your site and read it every day. Here is where to see both: the new ai-assistant medium in GA4, Cloudflare AI Crawl Control and your server logs — plus the list of AI bot user agents to look for.

ChatGPT, Gemini, Claude and Perplexity now send real visitors to websites. Their bots also read your pages every day — to train models or to answer someone's question right now. You can see both. Here are three places to look, from the easiest to the most complete.

1. Google Analytics 4: the ai-assistant medium

Since July 2026 GA4 groups visits from different AI assistants under one medium: ai-assistant. You'll find them in Reports → Acquisition → User acquisition.

  1. Open the User acquisition report.
  2. Click Add filter.
  3. Dimension: First user source / medium, match type: contains, value: ai-assistant.
  4. Apply.
GA4 filter: First user source / medium contains ai-assistant
The filter in GA4: First user source / medium contains “ai-assistant”.

Now every assistant gets its own row: chatgpt.com, gemini.google.com, claude.ai, perplexity.ai, copilot.com and so on. These visits are labelled very clearly, so you see exactly who sends people to you and how many of them come back.

GA4 User acquisition report filtered by ai-assistant: ChatGPT, Gemini, Claude, Perplexity, Copilot
A real breakdown: ChatGPT brings the most, Gemini is second, Claude and Perplexity follow.

Which pages AI sends people to

Open Reports → Engagement → Landing page and add the same kind of filter: Session source / medium contains ai-assistant. Now you see the pages AI assistants cite and people actually click.

What GA4 doesn't show

This is clean, well-labelled traffic — but not all of it. Many assistants and apps don't pass a referrer (Grok, for example, or links copied from a chat), so those visits land in Direct. Treat the GA4 number as the minimum, not the total.

2. Cloudflare: AI Crawl Control

If your site is behind Cloudflare, open AI Crawl Control → Overview. GA4 shows people; this shows the bots that read your site.

Cloudflare AI Crawl Control overview: requests from AI crawlers, allowed and unsuccessful requests, referrals
AI Crawl Control → Overview: how many requests AI crawlers made and how many visitors they referred.

What you can see there:

  • Summary — total requests from AI crawlers, the change vs the previous period and how many got an HTTP 200.
  • Metrics — total, allowed and unsuccessful requests, plus referrals. A jump in unsuccessful requests often means you block bots by accident.
  • Filters — pick one crawler or several at once, or a whole operator (OpenAI, Anthropic, Meta…).
  • Most crawled paths — the exact URLs bots visit most.
  • AI Answer volume — for each operator: how many requests it made to build answers and how many people clicked through to your site.
Cloudflare AI Answer volume: requests and click-throughs for Apple, OpenAI, Perplexity, Anthropic, Mistral
AI Answer volume: thousands of requests, only dozens of click-throughs.

Tip: compare Most crawled paths with your GA4 landing pages. Pages that bots read a lot but nobody clicks are the first ones to improve.

3. Server logs: every AI bot, no extra tools

Logs are the most complete source: every request with its user agent, on any hosting. Where to find them:

  • nginx: /var/log/nginx/access.log
  • Apache: /var/log/apache2/access.log or /var/log/httpd/access_log
  • Shared hosting: control panel → Logs / Raw access logs

Count hits per AI bot:

grep -oiE "GPTBot|OAI-SearchBot|ChatGPT-User|ClaudeBot|Claude-SearchBot|Claude-User|PerplexityBot|Perplexity-User|Google-CloudVertexBot|Applebot|Meta-ExternalAgent|Meta-ExternalFetcher|Amazonbot|MistralAI-User|DuckAssistBot|Bytespider|CCBot|cohere-ai|AI2Bot|YouBot|Diffbot" access.log | sort | uniq -c | sort -rn

See which pages they read:

grep -iE "GPTBot|OAI-SearchBot|ChatGPT-User|ClaudeBot|Claude-User|PerplexityBot" access.log | awk ' {print $7} ' | sort | uniq -c | sort -rn | head -20

AI bot user agents to look for

Company User agent What it does
OpenAI GPTBot Collects content for model training
OpenAI OAI-SearchBot Indexes pages for ChatGPT search
OpenAI ChatGPT-User Opens a page when a user asks ChatGPT
Anthropic ClaudeBot Collects content for model training
Anthropic Claude-SearchBot Indexes pages for Claude's search
Anthropic Claude-User Opens a page when a user asks Claude
Perplexity PerplexityBot Indexes pages for Perplexity answers
Perplexity Perplexity-User Opens a page when a user asks Perplexity
Google Googlebot Gemini and AI Overviews use the regular Google index
Google Google-CloudVertexBot Crawls for AI agents built on Vertex AI
Microsoft bingbot Copilot answers rely on the Bing index
Apple Applebot Siri, Spotlight and Apple Intelligence
Meta Meta-ExternalAgent Collects content for Meta AI training
Meta Meta-ExternalFetcher Opens a page on a user's request in Meta AI
Amazon Amazonbot Alexa and other Amazon AI services
Mistral MistralAI-User Opens a page when a user asks Le Chat
DuckDuckGo DuckAssistBot Builds DuckAssist answers
ByteDance Bytespider Collects content for model training
Common Crawl CCBot Open web archive used to train many LLMs
Cohere cohere-ai Content for Cohere models
Allen Institute for AI AI2Bot Collects content for open models
You.com YouBot Indexes pages for You.com answers
Diffbot Diffbot Builds a knowledge graph used by AI products

Two things to keep in mind:

  • Google-Extended and Applebot-Extended are robots.txt tokens, not user agents. You won't see them in logs — they only decide whether your content can be used for AI.
  • A user agent is easy to fake. To be sure a hit is real, check the IP: OpenAI and Perplexity publish their IP ranges, Google and Apple can be verified with a reverse DNS lookup.

Putting it together

  • GA4 — people who clicked from an AI answer, and the pages they landed on. The minimum, not the total.
  • Cloudflare — which bots read which pages, and how many click-throughs each operator brings.
  • Server logs — every AI bot hit, on any hosting.

Want to know how AI assistants see your site — and what to fix first? Get a free 10-minute audit.


Share this article:

Denis K

Need help with SEO or AI visibility?

I'm Denis — an SEO specialist with 11+ years of experience in the US, European and Russian markets. Tell me about your project and get a first assessment.

Discuss a project

More articles

All articles

What Works in SEO in 2026: A Playbook

Most SEO case studies don't prove that the tactic they describe caused the growth. This playbook keeps only what is backed by controlled tests or by how search actually works: foundations, content, snippets, commercial pages, links and structured data. Plus a list of things not worth your time.

Read article

Ready to Be Found — by People and by AI?

Tell me about your project and get a first assessment of your search and AI visibility.

I reply within 24 hours. No spam, no pushy sales.