01 / THE DATA DICTIONARY

Four metrics that must never be merged into a single score

When reporting AI search performance to a founder, team, or client, keep four distinct funnel layers in separate columns:

Metric Layer Unit of Measurement Primary Data Source Known Blind Spot
1. Sampled Prompt Mention % of benchmark test runs where brand/domain appears in answer text Repeatable API probes (e.g. Searchbop AI probe using OpenAI/Claude/Gemini) Reflects your chosen test prompts, not total global user conversation volume.
2. Grounding Citation Count of times a URL was attached as a source link in an AI answer Bing AI Performance report + structured citation URLs in API probes A cited link is an impression of a source card, not a click to your site.
3. AI Referral Session Human browser sessions arriving from an AI assistant surface GA4 / Web Analytics (`utm_source=chatgpt.com` & AI referrer regex) Mobile native app webviews or copy-pasted URLs can sometimes appear as `Direct`.
4. Assisted Conversion Signups, checkouts, or downloads from AI referral sessions or post-AI brand searches GA4 Key Events + Checkout attribution (e.g. Polar order metadata) Zero-click AI discovery often converts later via a branded Google search.
02 / GOOGLE ANALYTICS 4 SETUP

How to isolate ChatGPT, Claude, Perplexity, and Gemini traffic in GA4

According to OpenAI’s official publisher documentation, outbound links clicked inside ChatGPT Search include the query parameter utm_source=chatgpt.com. Other AI assistants pass their hostname in the standard HTTP Referer header when a user clicks a source card.

In Google Analytics 4 (which Searchbop can also read via your Google Service Account connection), create a custom Channel Group or Exploration filter matching the session source against this regular expression:

GA4 AI REFERRAL SOURCE REGEXMatches major conversational search referrers
^(.*chatgpt\.com|.*openai\.com|.*perplexity\.ai|.*claude\.ai|.*anthropic\.com|.*gemini\.google\.com|.*copilot\.microsoft\.com|.*you\.com|.*phind\.com)$

When analyzing these sessions, group them by Landing Page (`pagePathPlusQueryString`) and Key Events / Conversions. In almost every technical B2B and software site we inspect, AI referral traffic has lower raw session volume than traditional Google organic search, but significantly higher engagement time and conversion intent because the user already compared options inside the conversation before clicking your citation.

03 / GOOGLE SEARCH CONSOLE REALITY

How Google Search Console counts AI Overviews and AI Mode

A frequent question from site owners is: “Where is the separate AI Overviews filter in Google Search Console’s standard Search Analytics table?”

Per Google’s official documentation on AI features and your website, clicks and impressions from AI Overviews and AI Mode in Google Search are recorded inside your property’s overall Web search type performance data alongside traditional search results. When a user clicks a link to your site inside an AI Overview, it counts as a click in Search Console; when your link is rendered inside the overview container according to Google’s position rules, it counts as an impression.

While Google has announced specialized Generative AI performance reporting initiatives, you should never assume a third-party scraper can tell you the exact number of times your page appeared inside a personalized Google AI Overview unless that data comes directly from Google’s verified reporting APIs.

04 / BING WEBMASTER TOOLS

Using Bing’s AI Performance report for grounding queries

Microsoft’s Bing Webmaster Tools introduced a dedicated AI Performance report that shows how often your pages are cited as sources in Copilot and Bing generative summaries, along with the grounding queries used to retrieve your pages.

Understand the distinction between a user prompt and a grounding query:

Optimizing your pages for clear, specific technical questions helps your site match those synthesized grounding queries.

05 / GEO vs. AEO vs. SEO

Generative Engine Optimization (GEO) & Answer Engine Optimization (AEO) vs. SEO

In Google Trends comparisons over the past 12 months, broad terms like “AI SEO” and “AI visibility” attract far more search interest than academic phrases like “generative engine optimization” or “answer engine optimization.” More importantly, from an engineering standpoint, 90% of effective GEO/AEO is rigorous technical and editorial SEO:

  1. If retrieval bots cannot crawl or index your page, no LLM can cite it in live search: Every AI assistant with web search relies on an underlying search index (Google, Bing, or its own search crawler like `OAI-SearchBot`).
  2. Direct, front-loaded answers win citations: AI grounding models extract chunks of text that directly answer a question with concrete facts, numbers, tables, and code snippets. Burying the answer below 800 words of fluffy introduction hurts both human readers and LLM retrieval.
  3. Verifiable entity & schema clarity: Consistent product naming, pricing tables, `SoftwareApplication` / `TechArticle` / `Organization` JSON-LD, and clear authorship stop models from hallucinating what your product does or how much it costs.

Honest boundaries & official sources

No private prompt visibility: Neither Google Analytics, Search Console, nor any third-party tool gives you the verbatim private chat history of a user before they clicked a citation link on `chatgpt.com` or `claude.ai`. Treat UTMs and referrers as session-level attribution, and combine them with a "How did you hear about us?" prompt at checkout or onboarding for complete clarity.

Official documentation: OpenAI — Tracking Referrals from ChatGPT Search (`utm_source=chatgpt.com`) and Google Search Central — AI Features and Your Website.

Research context & topics covered on this page Measurement · P1

Cluster & intent: measurement (Informational · P1) · Planned URL: /guides/measure-ai-search-traffic/

Topics addressed: how to measure AI search visibility, ChatGPT referral traffic Google Analytics, AI Overviews Search Console report, generative engine optimization vs SEO, answer engine optimization vs SEO.

Primary documentation source: OpenAI Publisher FAQ.