In short
To measure AI search visibility, ask several AI systems a fixed list of real customer questions every month under the same conditions, each question at least three times. Count how often your business is mentioned, linked as a source and described correctly. The reports from Google and Bing also show how often your pages appear in their AI answers.
Key takeaways
- A single answer tells you little: in one study, about two-thirds of the cited sources changed from one day to the next.
- Count mentions, citations and correct facts separately, and always across all answers, including those without a web search.
- Three runs per question show a direction across many questions. For a single question, one study calls for at least seven.
- AI answers have no fixed position like a Google ranking: the selection and order of providers change with almost every query.
- Google counts impressions in AI Overviews and AI Mode; Bing counts citations in Microsoft Copilot. Neither report shows what people asked.
Which questions belong in your question panel?
Your question panel should contain the questions customers ask before they buy, each with fixed wording and its own ID. A question panel, also called a prompt panel, is a fixed list of questions you put to AI systems at regular intervals. It mixes questions about your company, about providers of your service and expert questions from your field.
Why questions about your company name aren’t enough: Whether an AI system knows your name and whether it mentions you when someone asks a general question are two different things. In a study of 112 startups from the Product Hunt leaderboard, ChatGPT recognized 99.4% of the products when asked about them by name, and Perplexity 94.3%. Only 3.32% and 8.29% of the products, respectively, came up for general questions such as “What are the best AI tools launched this year?” The study queried both providers through their programming interfaces (APIs), not through their apps. Our guide to generative engine optimization (GEO) explains how these systems choose their sources.
Source: Sharma (preprint) (external site), · 112 startups, 2,240 queries
Why use several wordings: People ask for the same thing in very different ways. In an experiment by SparkToro, people wrote 142 prompts about the same purchase, and barely two of them were alike. Even so, the four most frequent brands each appeared in 55–77% of the 994 answers. So a fixed panel can’t cover every wording, but it does show whether you’re among the providers that get named. Even small edits to the wording change the sources of Google’s AI Overviews, as a study from the SIGIR 2026 conference (external site) shows.
Source: SparkToro (external site), · vendor study · 142 human-written prompts, 994 answers
How to do it:
- Collect questions from inquiries, emails and first meetings. Add question-style queries from the Google Search Console performance report (external site) and search terms from Bing Webmaster Tools (step 5).
- Assign each question to a group: company (“What does [company] offer?”), provider (“Who offers [service] in [place]?”) or expert question (“How much does [service] cost?”).
- Phrase your most important questions in two or three different ways. A survey of GEO research (external site) recommends three to five paraphrases per information need for studies.
- Give each question an ID, such as Q01, and a target page on your website. After that, never change the wording; a new wording gets a new ID.
- Start with 10 to 20 questions; in our view, that’s enough to begin with. With every additional question, the share of answers that mention you becomes more reliable: SparkToro considers it a reasonable metric across dozens to hundreds of prompts, each run several times.
Example: Our own panel includes this expert question, phrased in German: “How can I measure my company’s AI visibility?” Its target page is the German version of this how-to.
Common mistake: Your panel only contains questions that include your company name. It then shows whether AI systems know you, but not whether they mention you to potential buyers.
Done when your list has 10 to 20 questions, each with an ID, a group, fixed wording and a target page, and all three groups are represented.
Which AI systems should you ask, and under what conditions?
Measure in the AI systems your customers use, and analyze each one separately. Keep the conditions the same every time: no personal history, a new chat for each question, prompts in German from a German location, and all systems on the same day. Also note how you access each system: ChatGPT answers differently through its API than in its app.
Why each system separately: Profound tracked the citations of 883,000 pages in seven AI systems over 12 months. Gains or losses in one system said nothing about the others. Profound itself sells a tool for this kind of measurement.
Source: Profound (external site), · vendor study · 883,000 pages, seven AI systems
Why no personal history: Being signed in changes the answers. According to OpenAI, ChatGPT draws on past conversations as long as memory (external site) is turned on; a temporary chat doesn’t use memory. Since February 2025, ChatGPT search has also worked without an account (external site). Gemini (external site) can personalize answers for signed-in users based on memory of their past chats. Google says Search results depend on the time, place, device and recent history of the person searching (Search Console Help on the Performance report (external site)).
Why the access method matters: Some tools query AI systems through their APIs. With ChatGPT, the answers there differ from those in the app. In one study, OpenAI’s API with web search and Google Search together found only about a quarter of the pages that ChatGPT cited in the browser. They found about half of the websites behind those pages.
Source: Jiang, Zhang, Xing, Chang, Xiao (preprint) (external site), · 80 questions, 20 runs each
How to do it:
- Choose two to four systems your customers use; if in doubt, ask new contacts (step 6). Candidates include ChatGPT, Google’s AI Overviews and AI Mode, Microsoft Copilot, Perplexity, Gemini and Claude.
- Ask while signed out, in a private browser window or a temporary chat. Use a new chat for each question, with no follow-up questions.
- Copy and paste the exact wording. Ask from a German location, without a VPN that places you elsewhere. Query all systems on the same day, in the same week every month.
- For each answer, note the system, the access method (app, browser or API), the model shown, whether the system searched the web, the answer text and all sources shown. A screenshot helps if questions come up later.
Example: For our own measurement, we plan to use APIs to query Claude with web search, Perplexity and Google’s AI Mode, as well as ChatGPT, Gemini and Google’s AI Overviews. We’ll also check ChatGPT and Microsoft Copilot by hand in their regular interfaces as a spot check, signed out and from a German location. Our methodology has the details.
Common mistake: You measure in your own account, where you’ve already asked about your company many times. The answers may then be based on your earlier chats.
Done when the header of your tracking sheet lists the access method, sign-in status, language, location and measurement day for each system.
How many times should you ask each question?
Ask every question in every system at least three times, each time in a new chat. Three runs show a direction across many questions. For a reliable conclusion about a single question, a study using German-language prompts calls for at least seven runs on the same day, and eight for cited sources.
Why: AI answers vary even when nothing has changed. In this study, about two-thirds of the cited sources changed from one day to the next on average, and questions asked in quick succession varied almost as much. The study covered ChatGPT, Gemini, Google’s AI Mode and Perplexity, with questions from four industries, from January to March 2026. Our GEO guide summarizes other measurements of this fluctuation.
Source: Schulte, Bleeker, Kaufmann (preprint) (external site), · four AI systems, queried from servers in Switzerland
The table, from the same study, shows how precise the mention rate for a single question is after a given number of runs. With three runs, a question whose answers mention you half the time on average can therefore come out anywhere between about 13% and 87%. If you’re always or never mentioned, the authors say fewer runs are enough.
| Runs per question per day | Uncertainty (95% interval) |
|---|---|
| 1 | ±72 percentage points |
| 3 | ±37 percentage points |
| 5 | ±24 percentage points |
| 7 | ±16 percentage points |
| 8 | ±12 percentage points |
Source: Schulte, Bleeker, Kaufmann (preprint) (external site), · Appendix J, Table 16, mean of 1,216 brand series
How to do it:
- Ask each question at least three times per system. The runs can follow each other directly: according to the study, they vary almost as much as runs on different days anyway.
- With three runs, analyze groups of questions, such as all provider questions. Draw conclusions about a single question only once you have seven runs or more.
- If you measure daily, for example with a tool, combine two to four weeks. The authors recommend this to get stable values for individual brands.
- With fewer than 20 answers, report the count, such as “3 of 9 answers,” instead of a percentage.
Example: Our worked example under “From our work” shows how precise a rate across many answers is.
Common mistake: Each question runs once, and the result triggers an action for that one question.
Done when every question has at least three timestamped runs per system in your tracking sheet. Your report only draws conclusions about single questions with seven or more runs.
Which metrics should you track?
For each answer, record separately whether your company is mentioned, whether one of your pages is linked as a source and whether the facts about you are correct. That gives you your mention rate, citation rate and accuracy rate, each based on all answers. Your position in lists and the cited sources complete the picture.
| Metric | How to calculate it | What it shows |
|---|---|---|
| Mention rate | answers that name you, divided by all answers | whether AI systems mention you at all |
| Citation rate | answers that link to at least one page of your website as a source, divided by all answers | whether your website serves as evidence |
| Accuracy rate | answers to questions about your company with the core facts right, divided by all those answers | whether your name, location and services are right |
| Recommendation rate | answers that recommend you or put you on a shortlist, divided by all answers to provider questions | how close you are to a buying decision |
| Position | your rank among the providers named, only in answers with a list | your rough place in the selection, reported as a range |
| Answers with sources | answers with at least one source shown, divided by all answers | how often the system searched the web at all |
| Share of mentions | your mentions divided by all mentions of the providers on your comparison list | your weight next to competitors |
| Cited domains | all websites cited for each question, sorted by type | where you should appear |
What to watch for when counting:
- All answers in the denominator: In the study with German-language prompts, ChatGPT showed at least one source in only 42.2% of runs. For questions about definitions, it often didn’t search at all (Schulte et al. (external site)). According to the survey (external site), answers without a search or without sources are “outcomes, not data to be discarded.” Leave them out, and your citation rate comes out too high.
- Domain first, then page: The specific page that gets cited changes even more often than the website (SISTRIX (external site)). Repeated runs in ChatGPT often retrieved different pages from the same websites (Jiang et al. (external site)). So count the citation for your domain, and note the page as well.
- Position as a range: In SparkToro’s research, the same brand list in the same order came up less than once in 1,000 runs. For SparkToro, a “ranking position in AI” is therefore nonsense. Report the range or the median across all answers with a list.
- No single score: Microsoft says the new metrics in Bing Webmaster Tools “do not turn AI visibility into a single ranking or score” (Microsoft Bing, Jun 16, 2026 (external site)). If a tool shows you an AI visibility score from 0 to 100, ask for the numerator and denominator.
- Define your core facts in advance: According to Bitkom, 42% of those who use AI for search say they’ve already received false or made-up information from an AI. Before your first measurement, decide which facts must be right, such as your name, location, services and website.
Source: Bitkom (in German) (external site), · 1,156 respondents aged 16+
Our how-to on getting recommended by ChatGPT shows how to sort cited websites by type and what to do with the result.
Common mistake: Only linked citations get counted, and mentions without a link drop out. Missing links are common: according to Bitkom, only just over a third of respondents (36%) feel that AI backs up its answers with enough links.
Done when your analysis gives the numerator and denominator for every metric and includes answers without sources.
What do the Google and Bing reports show?
In Google Search Console, the generative AI performance report shows how often links to your website appeared in AI Overviews and AI Mode. It doesn’t include clicks or search queries. In Bing Webmaster Tools, AI Performance shows how often Microsoft Copilot and Bing cite your pages as sources, plus a sample of the search phrases behind those citations.
| Feature | Google: generative AI performance report | Bing: AI Performance |
|---|---|---|
| AI surfaces | AI Overviews, AI Mode | Microsoft Copilot, AI-generated summaries in Bing, select partners |
| Metric | impressions: how often links to your website were shown | citations as a source, average cited pages; in preview, your share of all citations for each query |
| Queries | none | a sample of the phrases the system used to retrieve content (grounding queries); in preview, grouped by intent and topic |
| Breakdown | page, country, date, device; text or image search | page, trend over time, comparison with an earlier period |
| Clicks | not in this report; the standard performance report counts clicks on links in these features | not among the metrics |
| Other websites | no data | shares without naming other domains |
| Requirements | enough impressions; site not excluded from generative AI features | Topics Portfolio (beta) only with enough data |
| Available | for all websites since Aug 31, 2026 | preview since Feb 10, 2026, expanded Jun 16 and Oct 13, 2026 |
Source: Google Search Console Help (external site), · generative AI performance report
Source: Microsoft Bing (external site), · AI Performance, expanded Jun 16 and Oct 13, 2026
What an impression means: Google generally counts an impression as soon as a link is on the current results page, even if nobody scrolls down to it. All links in an AI Overview share a single position (Search Console Help (external site)). So an impression doesn’t mean that anyone has read your page.
What Bing’s grounding queries mean: Grounding queries are the search phrases the AI system used to retrieve content. You won’t see the question a person actually asked. Google’s AI Mode also breaks a question down into subtopics and searches for each one. Our article on query fan-out explains more. Since October 2026, Bing’s Topics Portfolio (beta) has also shown queries where other websites are cited and yours isn’t. According to Microsoft, smaller websites may not see this view at all (Microsoft Bing, Oct 13, 2026 (external site)).
What’s missing: As of November 2026, we found no comparable report for website owners from the providers of ChatGPT, Perplexity, Claude or the Gemini app. For these systems, your question panel remains the most important source. Our article on AI Overviews and AI Mode explains how Google chooses the sources for its AI answers.
How to do it:
- Add your website to Google Search Console and Bing Webmaster Tools if you haven’t already.
- Make sure your site is included in generative AI features in Search Console; otherwise the report stays empty. The first step of our ChatGPT how-to has more on this.
- Export both reports on your measurement day and file them with your tracking sheet.
- Add queries that keep showing up in Bing to your list of candidates for new questions.
Common mistake: Impressions from AI Overviews are read as visits.
Done when both reports are set up and you file their figures every month on your measurement day.
How can you spot visits and fetches from AI systems?
You can spot visits from AI assistants in your web analytics by the referring website, and fetches by AI systems in your host’s server logs. Both only capture part of the picture: anyone who reads an answer and doesn’t click leaves no trace there. So ask new contacts how they found you.
- Web analytics: Google Analytics has its own “AI Assistant” channel for visits from services such as ChatGPT, Gemini, DeepSeek, Copilot or Grok. According to Google (external site), this channel explicitly excludes visits from Google’s AI Overviews and AI Mode.
- Server logs: When an AI assistant fetches your page to answer a user’s question, the request shows up in your logs. The user agents for this are ChatGPT-User at OpenAI (external site), Claude-User at Anthropic (external site) and Perplexity-User at Perplexity (external site). Such a fetch shows that a system opened your page for an answer. It doesn’t show whether the system cited it. Our how-to How to track AI traffic beyond GA4 shows step by step how to analyze visits and fetches in your logs.
- Authenticity: A user agent can be faked; Google, for example, explains how to verify requests that claim to come from Google (Google for Developers (external site)). OpenAI and Perplexity publish the IP addresses they fetch from, so check the fetches against those lists. Our article on AI crawlers covers which crawlers exist and what they’re for.
- Asking new contacts: Ask them how they found you. That way, you also hear about recommendations in AI answers that nobody clicked.
Why rising numbers call for caution: AI services are growing themselves. On one large website, total referrals from ChatGPT grew 5.7-fold, but pages on the same site that hadn’t been changed still grew 3.5-fold. The authors call the effect of their changes “suggestive, not conclusive.” So always compare the pages you’ve worked on with pages you haven’t changed.
Source: Watanabe, Nakayashiki (preprint) (external site), · one website, web analytics and server logs
Example: Our contact form asks an optional question: “How did you hear about us?” The choices include ChatGPT, Perplexity, Microsoft Copilot, Gemini, Claude and “Google AI Overviews or AI Mode.”
Common mistake: Crawler fetches get counted as visits, or a rise in referrals is credited to your own work without a comparison with unchanged pages.
Done when you see visits from AI assistants separately, can tell user-initiated fetches apart from other crawlers and ask new contacts how they found you.
When is a change real?
A change only counts as a trend once the new monthly value falls outside the range of your runs and holds the following month. To judge that, log every known model change, every major Google update and every change you make, each with its date. Don’t compare values from before and after a model change directly.
Why: A new model can swap the sources overnight. After ChatGPT switched from GPT-5 mini to GPT-5.5 on May 23, 2026, the domains cited in German-language answers shifted by 47% within 48 hours, according to SISTRIX. In the days before, the shift was 1–2%. SISTRIX itself calls this a correlation, and it sells a tool for this kind of measurement.
Source: SISTRIX,
How to do it:
- Keep a change log with the date, system, event and source. Google reports major Search updates in the Google Search Status Dashboard (external site), such as the core update from May 21 to June 2, 2026. Add model changes as soon as a provider announces them.
- Calculate the monthly value as the mean of the run values. The range runs from the lowest to the highest run value.
- Only treat a change as a trend if the monthly value falls outside the previous month’s range and stays there the following month. Our methodology applies the same rule.
- If a model change falls between two measurements, report the values separately and restart the trend rule.
- When you change something yourself, note the date and the pages affected. Then compare questions whose target page you changed with questions where nothing changed.
Worked example: Your three runs in February produce mention rates of 13%, 23% and 17%. The monthly value is 18%, and the range runs from 13% to 23%. A March value of 20% is within the range, so it’s a fluctuation. If March comes in at 30% and April also stays above 23%, treat that as a trend.
Common mistake: A good month gets celebrated, and a bad one sets off hasty changes.
Done when your change log is running and every monthly report says whether a change is a fluctuation or a trend.
Which tools help you measure?
A spreadsheet, the free reports from Google and Bing, your web analytics and your server logs are enough to start with. Paid AI visibility tracking tools ask many questions automatically, often daily. Choose such a tool based on how openly it describes its access method, questions and runs.
| Source | What it shows | What it doesn’t show |
|---|---|---|
| Tracking sheet with manual queries | mentions, citations and facts in the systems and under the conditions you choose | many questions and runs, unless you put in a lot of manual work |
| Google Search Console | impressions in AI Overviews and AI Mode for each page | clicks and queries in this report, other AI systems |
| Bing Webmaster Tools | citations in Copilot and Bing, a sample of queries | other providers’ systems, apart from select partners |
| Web analytics | visits from AI assistants | answers without a click |
| Server logs | crawler fetches and user-initiated fetches | whether a page was cited |
| Tracking tools | many questions, systems and days, automatically | depending on the tool, unclear: access method, where the questions come from, variation |
| Asking how people found you | where an inquiry came from, even without a click | everyone who doesn’t get in touch |
Questions to ask about a tracking tool:
- Which systems does it query, and through which access method: app, browser or API?
- Does it ask in German and from a German location?
- Does it use your own questions, or does it generate questions itself? Can you see every question?
- How many runs does it do per question, and does it show the variation?
- Can you see the answer text and all sources of every answer, and can you export the raw data?
- Does it count answers without sources?
- Does it flag model changes?
- How is an overall score calculated, and what’s in the denominator?
Why be wary of promises: Google advises site owners to “be wary of third-party tools that promise ranking success” or claim to use internal Google metrics. According to Google, no third-party tool has access to its internal ranking or AI systems (Google Search Central, as of Jul 10, 2026 (external site)). Our how-to on choosing a GEO agency lists the questions to ask an agency about its measurement.
Example: We’ll run our own panel with a question list and one row per answer. The template is below, under “From our work.”
Common mistake: A tool gets bought for its score, without anyone knowing which questions and runs are behind it.
Done when you can answer all eight questions for your tool, or you measure by hand with the template.
What can’t the measurement tell you?
Measuring with a fixed set of questions gives you a sample: it shows how AI systems answer your questions under your conditions. It doesn’t show what individual people with their own history see. Nor does it show why a system picks a source or whether a mention turns into a sale. That’s why these limits belong with every figure.
- No view inside the system: You see answers, but not the reasons behind them. The survey describes the path from search to answer as subject to chance and only partly observable.
- A citation doesn’t prove a correct statement: The same paper notes that “a visible citation may be incorrect.” So for questions about your company, read what the answer actually says.
- Visibility has many levels: The research literature uses the term “visibility” for at least nine different quantities, from whether a search is triggered to clicks and revenue. A mention isn’t a click yet, let alone an order.
- Many studies come from vendors: Several of the analyses cited here come from companies that sell measurement tools, and others are preprints that haven’t been peer-reviewed. We say so each time; for example, one of the authors of the SparkToro study works for an AI tracking vendor.
Source: Martinez (preprint) (external site), · survey of 45 studies
What our own measurement can’t do is set out in our methodology under What this measurement isn’t.
Common mistake: A value from your panel is presented as a market share in ChatGPT.
Done when your report states the period, systems, number of answers and limits of the measurement for every figure.
What’s different about measuring in Germany and the EU?
To see what buyers in Germany see, measure in German and from a German location, because results from other countries don’t simply carry over. Also record which language the cited sources are in. Analyze server logs so that you store only the result.
-
Countries differ: According to SISTRIX, 74% of the domains ChatGPT cited in Germany were new each week, compared with 60% in the UK and 42% in France. SISTRIX measured from December 2025 to April 2026. In another study, the same English questions produced an AI Overview less often from Germany than from the US: for 65% instead of 81% of the questions (Kirsten et al. (external site)).
Source: SISTRIX (external site), , updated · 82,619 prompts, six countries, 17 weeks
-
Where the studies ran: The study with German-language prompts collected its data from servers in Switzerland. The authors themselves write that the location can affect which sources get chosen.
-
Language of the sources: Note whether German- or English-language pages get cited. The section on Germany and the EU in our ChatGPT how-to explains why this matters.
-
Server logs: When you analyze them, check IP addresses against the providers’ lists, then store only the result, such as “ChatGPT user-initiated fetch.” That way, your analysis needs very little data. Our own website sets no cookies, and we’ll count fetches from our server logs without IP addresses (our measurement principles).
Done when your tracking sheet states the language and location of every query and the language of the cited sources for every answer.
From our work: which columns does your tracking sheet need?
Our tool for our own question panel works with two files: a question list and an answer file with one row per answer. The template below is a simplified version that you can copy into any spreadsheet. Our panel for datafalke.de has 40 core questions, 29 in German and 11 in English, which we plan to ask every month, with three runs each. We’ll only publish our own figures together with the measurement log in our methodology.
question_id,group,question,target_page,since
Q01,company,What does [company] offer?,/,2026-12-01
Q02,provider,Who offers [service] in [place]?,/services/,2026-12-01
Q03,expert,How much does [service] cost?,/insights/[article]/,2026-12-01date,time,system,access,model,location,question_id,run,web_search,mentioned,cited,cited_url,recommended,position,facts,sources,note
2026-12-01,09:12,ChatGPT,browser (signed out),as displayed,Germany,Q02,1,yes,yes,no,,no,3,,example.org|example.net,names three providers- web_search: yes if the answer shows sources. Answers without sources stay in the sheet.
- mentioned, cited, recommended: yes or no. Cited means that a page on your domain is among the sources shown.
- position: only for answers with a list of providers; otherwise leave it blank.
- facts: only for questions about your company: correct, partial, wrong or none.
- sources: all sources shown, in their order, separated by a vertical bar.
Worked example: how precise is a mention rate of 20%? The table shows the range in which the true value lies with 95% confidence if you’re mentioned in 20% of the answers. We calculated it with the Wilson method from the e-Handbook of Statistical Methods (external site) by NIST, the US National Institute of Standards and Technology. If you aren’t mentioned even once in 90 answers, the same method puts the true rate below 4.1%, with 95% confidence.
| Answers | Setup | Range (95%) |
|---|---|---|
| 30 | 10 questions, 1 system, 3 runs | 9.5–37.3% |
| 90 | 10 questions, 3 systems, 3 runs | 13.0–29.4% |
| 180 | 15 questions, 4 systems, 3 runs; the size of our AI visibility audit | 14.8–26.4% |
Source: NIST/SEMATECH (external site), · undated handbook, date of access; our own calculation
These ranges assume that every answer is independent of the others. Because the same questions run several times, the real uncertainty is larger; the survey (external site) explicitly warns against treating repeated answers as independent. That’s why the values from our AI visibility audit also only show a direction.