---
title: "AI Traffic analytics"
description: "AI crawler visits (GPTBot, OAI-SearchBot, PerplexityBot, ClaudeBot) and clicks from AI answers, per page."
url: https://searchmention.com/ai-traffic
---

AI Traffic Analytics

# See every AI bot and
chat referral hitting your store

GPTBot, ClaudeBot, PerplexityBot, OAI-SearchBot — plus real referral clicks from chatgpt.com and perplexity.ai. One Cloudflare Worker, a live timeline, no GA4 noise.

[ Start free  ](https://searchmention.com/register) [ Cloudflare Worker setup ](https://searchmention.com/guides/cloudflare-worker-manual)

Available on Starter and Growth · Setup in under 5 minutes

The problem

## GA4 wasn't built for the AI traffic era

Google Analytics filters out bots by default — including GPTBot and friends. ChatGPT referrals get bucketed as "direct" or lost in "Other". And bot crawls don't show up at all. The result: a fast-growing slice of your traffic is invisible.

What GA4 misses

- · Bot traffic (filtered by default)
- · Crawls per AI provider
- · ChatGPT/Perplexity as named sources
- · Which pages AI is reading right now

What SearchMention shows

- · All major AI bots, individually
- · Real chat referral clicks
- · Top pages AI traffic actually hits
- · Hourly/daily/weekly breakdowns

What we track

## Bots and humans, both labeled correctly

We split AI traffic into two streams: **crawls** (training and indexing bots) and **referrals** (humans clicking from a chat answer). They mean different things and need different responses, so we keep them separate.

- **5+ bots tracked individually** — GPTBot, OAI-SearchBot, ChatGPT-User, ClaudeBot, PerplexityBot. Add custom user agents from the dashboard.
- **Real referral clicks** — visits from chatgpt.com, chat.openai.com, perplexity.ai, and other AI surfaces, parsed from the Referer header.
- **Top pages by AI source** — which URLs each AI bot is hitting, so you know what they're learning from your store.
- **Hourly / daily / weekly trends** — spot patterns, see crawl spikes after content changes, and confirm fixes are reaching AI.

Setup

## Two paths, both fast

Pick whichever fits your stack. Both ship the same data into your AI Traffic dashboard.

### Cloudflare Worker

Deploy a tiny Worker in front of your store. Zero changes to your origin, zero perf impact, every request logged.

- · Free Cloudflare account
- · ~5 minutes to deploy
- · Works for any platform behind Cloudflare

[View setup guide →](https://searchmention.com/guides/cloudflare-worker-manual)

### Direct API

Already have an edge function, middleware, or backend logger? Forward bot/referral hits to our ingest endpoint with your API key.

- · Bearer-token auth (sm\_pixel\_…)
- · Batch or per-request
- · Works with Vercel, Netlify, custom edge, etc.

[Get your API key →](https://searchmention.com/register)

What you'll do with it

## From "is anything working" to specific decisions

### Confirm AI is reading you

After unblocking GPTBot in robots.txt, see crawl rates jump within hours. Real signal that your fix landed.

### Spot which pages AI loves

Top pages by GPTBot hits = pages AI considers most useful. Treat them as your strongest content templates.

### Measure ChatGPT referral revenue

Pair AI Traffic referral counts with your store's order data — finally answer "is ChatGPT actually sending me buyers?"

Pair with

## The full AI search picture

[AI Readiness

### Make sure AI can read you in the first place

If your robots.txt blocks GPTBot, AI Traffic will show zero crawls — and not because we missed them. Run the free readiness scan first.

](https://searchmention.com/ai-readiness) [AI Visibility

### Track which prompts mention your store

AI Traffic shows what reaches you. AI Visibility shows what AI says about you in answers. Complementary signals.

](https://searchmention.com/ai-visibility)

## Frequently asked questions

GA4 filters out bot traffic by default — it's not designed to surface GPTBot, ClaudeBot, etc. ChatGPT and Perplexity referrals also frequently get bucketed as "direct" or lost in "Other / Unassigned" because their Referer headers vary. SearchMention is built to label AI traffic specifically and keep crawls vs referrals separated.

No — the Worker runs at the edge in under a millisecond and forwards data to us asynchronously. Your origin response is unchanged. If anything, it's faster than running a third-party JavaScript tag client-side.

Bots: GPTBot, OAI-SearchBot, ChatGPT-User, ClaudeBot, PerplexityBot, PerplexityUser, plus a few more we add as they emerge. Referrers: chatgpt.com, chat.openai.com, perplexity.ai, gemini.google.com, and others. You can add custom user agents to track from the dashboard.

We collect request-level data: timestamp, user agent, referrer, path, country (from CF). No cookies, no IP storage, no personal data. It's purely server-side traffic metadata.

AI Traffic is on Starter ($29/mo) and Growth ($99/mo). Free does not include it — you'll see the dashboard with an upgrade prompt. Both paid plans include unlimited event ingestion.

Yes. The Cloudflare Worker is the easiest path, but you can also POST events to our ingest endpoint from any backend, edge function (Vercel, Netlify), or middleware. The dashboard is identical either way.

## Stop guessing whether AI sees your store

Deploy the Worker today and watch the bot timeline fill in within hours.

[ Start free  ](https://searchmention.com/register) [ Cloudflare Worker setup ](https://searchmention.com/guides/cloudflare-worker-manual)
