{"title":"How Reliable Is AI Visibility Tracking? Four Studies and a Practical Framework","url":"https://outwrite.ai/research/ai-visibility-tracking-reliability","type":"Research review","modified":"2026-10-30T09:00:00-04:00","methodology":"Reviewed four original reports on October 30, 2026. Sonar Pro assisted discovery; original sources were inspected directly. One truncated discovery response was excluded. Sonnet assisted synthesis and a separate review. The monitoring workflow is our editorial interpretation, not an original measurement study. Statistics retain their distinct platforms, populations and denominators.","disclosure":"outwrite.ai sells content research, writing and publishing software. These recommendations are editorial judgments, not measured ranking effects or promises of recommendations.","sources":[{"id":"1","title":"AI recommendation consistency research","publisher":"SparkToro / Rand Fishkin with Gumshoe.ai","url":"https://sparktoro.com/blog/new-research-ais-are-highly-inconsistent-when-recommending-brands-or-products-marketers-should-take-care-when-tracking-ai-visibility/","published":"January 27, 2026","period":"November-December 2025","sample":"600 volunteers, 12 prompts, 2,961 combined runs across ChatGPT, Claude and Google AI surfaces.","finding":"Examines recommendation-list consistency and individual brand appearances.","limitation":"Small prompt set, varied personal settings, vendor involvement; not a population survey.","checked":"2026-10-30","verified":true},{"id":"2","title":"How volatile are AI responses?","publisher":"Detailed / Glen Allsopp","url":"https://detailed.com/ai-volatility/","published":"September 23, 2026","period":"August 26-September 22, 2026","sample":"Daily US logged-out checks across two platforms.","finding":"Selected leading brands recurred.","limitation":"Two platforms; selected prompts; automated brand extraction; author works at Ahrefs.","checked":"2026-10-30","verified":true},{"id":"3","title":"AI citation drift: how stable are sources in AI search results?","publisher":"SISTRIX / Johannes Beus","url":"https://www.sistrix.com/blog/ai-citation-drift-how-stable-are-sources-in-ai-search-results/","published":"May 1, 2026; modified May 12","period":"December 17, 2025-April 8, 2026 (17 weekly reference dates)","sample":"82,619 qualified prompts; 1,548,213 snapshots; six countries; AI Mode, AI Overviews and ChatGPT Search.","finding":"Measures changes in cited domains across weekly observations.","limitation":"Domain-level snapshots; ChatGPT subset required consistent source attribution; does not measure traffic.","checked":"2026-10-30","verified":true},{"id":"4","title":"Quantifying uncertainty in AI visibility","publisher":"Ronald Sielinski / arXiv v3 preprint","url":"https://arxiv.org/html/2603.08924v3","published":"August 26, 2026 revision","period":"Nine-day observation window; exact calendar dates not used in this review","sample":"Three consumer-product topics; 200 generated queries per topic; daily and ten-minute regimes.","finding":"Examines uncertainty in repeated citation measurements.","limitation":"Preprint; synthetic queries; Gemini excluded from high-frequency regime; limited topic and time coverage.","checked":"2026-10-30","verified":true}],"chart":{"sourceId":"2","title":"Selected leaders often returned in the following fortnight","description":"Leaders selected per prompt from the first 14 days, then checked over the following 14. US, logged out; August 26-September 22, 2026. Not an estimate for every brand.","unit":"Share of subsequent days with selected leader present","rows":[{"label":"ChatGPT","value":79},{"label":"Google AI Overviews","value":85}]}}