Are AI answers personalised, and does it matter?

AI answers differ between people for three reasons: personalisation (memory, saved instructions, account history), context (location, language, the conversation so far) and chance (answers vary between runs). For tracking, ask from a clean session in your buyers’ market, many times, and do not judge your visibility from your own logged-in account.

Updated 5 min read

AI answers are not the same for everyone. Two people asking ChatGPT, Google AI Overviews or Perplexity the same question can see different brands named, for three reasons: personalisation, context and chance. For anyone tracking a brand, the practical consequence is simple: what you see in your own account is not what your buyers see.

Understanding the three reasons is the basis of measuring it properly, and so of AI search analytics.

Reason 1: Personalisation

Assistants increasingly remember things about the person asking.

  • Memory of earlier conversations. Anthropic describes Claude’s chat search and memory, which let it search previous conversations and build on earlier context. Other assistants offer similar features.
  • Saved instructions and preferences. Claude’s personalisation features include profile instructions that apply to every conversation.
  • Account activity. Google says its Web & App Activity setting saves searches and activity, and that people may get more personalised experiences from it.

If you have spent weeks asking an assistant about your own company, it may bring that context into a buyer-style question. Your colleague, or a real buyer, starts without it.

Reason 2: Context

Even without personalisation, the situation of the question changes the answer.

ContextHow it changes the answer
LocationGoogle says location can make search results more locally relevant, using signals such as IP address. Engines that search the web inherit this
Language and marketThe same question in another language or country can draw on different sources
The conversation so farEarlier messages in the same chat shape the next answer
Settings and modelPerplexity, for example, lets you leave the model on Best or choose a specific model, which can change the answer
WordingLanguage models are sensitive to small changes in a prompt (Sclar et al.), so a reworded question is a different question

Reason 3: Chance

The biggest source of variation is often neither. Ask the same assistant the same question twice, from the same clean session, and the answer can name different brands or put them in a different order. Language models generate text with some randomness, and assistants that search the web may retrieve different pages each time.

This is why one answer proves little, and why a visibility number needs a margin of error. How AI search engines choose brands explains where the variation comes from.

What it means for tracking your brand

MistakeBetter practice
Checking from your own logged-in accountUse a clean session with no memory, instructions or history
Checking from your office locationAsk from the market your buyers are in
Asking a follow-up in the same chatStart a new chat for every question
Rewording the question each timeKeep the wording fixed
Judging from one answerAsk many times and report the share of answers that name you

The goal is to measure what a new buyer would most likely see, not what you see. How to track your brand’s visibility in ChatGPT sets out the routine step by step.

Does personalisation make tracking pointless?

No. Personalisation changes some answers for some people, but the pages engines read and the brands those pages recommend are the same for everyone. If the sources for your buyers’ questions do not mention you, a clean-session answer will not name you, and neither will most personalised ones. Tracking from a clean session measures the part you can influence: what the shared sources say.

A clean-session answer is the closest thing to what a new buyer sees. Your own account is the furthest.

Where Citino helps

Citino is an AI search analytics tool. It asks ChatGPT, Google AI Overviews and Perplexity your buyers’ questions every day, with Gemini, Google AI Mode and Claude as add-ons, from a clean session with no account history or personalisation and with fixed wording, and reports each number with a margin of error, as the methodology sets out. See how Citino measures.

Questions people ask

Does ChatGPT give everyone the same answer?

No. Answers vary from one run to the next even for the same person, and assistants can also use saved memory, custom instructions, location and the earlier conversation. Two people asking the same question can see different brands named.

Why does ChatGPT name my brand for me but not for my colleague?

Probably because your account has context theirs does not: past conversations about your company, saved preferences, or searches in the same chat. That is one reason your own logged-in check is a poor measure of what buyers see.

Is the variation between answers personalisation?

Mostly not. Much of it is chance: language models produce different answers from run to run even with the same input. Personalisation adds to that when an account has memory, instructions or history the model can use.

How do I measure AI visibility if answers are personalised?

Measure what a new buyer would see: a clean session with no memory or history, fixed wording, the buyer’s location and language, asked many times. Report the share of answers that name you, with a margin of error, rather than any single answer.

See where AI names you
on every engine, every day

Citino asks the questions your buyers ask and tells you whether your fixes worked.

Experiments · net of competitors Illustrative
  • Crateline comparison page+4.1 ptsConfirmed
  • 3PL billing page rewrite+7.8 so farMeasuring
  • Shopify integration guide−4.5 ptsNegative
  • Pricing page refreshwithin noiseInconclusive