Method before findings.
Every number we publish will come from the same process. If a result can't be reproduced, we won't publish it.
Fixed prompt sets
We write buyer-intent questions up front and never change them mid-study.
Repeated runs
Each prompt runs several times per engine, because answers vary from run to run.
Structured logging
We record who is named, how they are described, which sources are cited, and the date.
Scheduled re-tests
We re-run on a schedule, so changes over time are measured, not remembered.
Why measuring AI answers is hard.
Honest measurement starts with what can distort it.
Answers vary
The same question can produce different answers on different runs, so one screenshot proves little.
Context matters
Location, settings, account history and how a question is phrased can all change what an engine says.
Engines change
Models and search features are updated often, so a result is a snapshot of one date, not a permanent fact.
Studies in progress.
No findings are published yet. These are the questions we are testing first, and we will publish the method alongside every result.
How consistent are AI answers?
How often does the same buyer question return the same brands across repeated runs and across engines?
Which sources get cited?
For category-comparison questions, how often are brand sites, review sites, publications and forums cited?
Does structured data change citations?
Do pages with matching FAQ or organization markup get cited more often than similar pages without it?
Get the first study.
One email when we publish. No spam.