GEO Testing

Generative Engine Optimization (GEO): Stop Guessing and Start Testing

A comprehensive guide to GEO A/B testing for ecommerce. Learn how to move from guesswork to data-driven optimization in the age of AI-powered search.

πŸ‘€ Conqur AI Team
β€’ November 18, 2024 β€’ 18 min read

For years, search has been your biggest channel, but it's also been the least understood. You've built robust SEO strategies to compete on a familiar battlefield. But that battlefield is changing.

With the rise of AI-powered search, the customer journey is fundamentally shifting. More research, comparison, and consideration now happens within the AI model, long before a user ever clicks through to a website. This presents a new challenge: as the traditional search results page fades in importance, search is going dark. How do you influence a journey you can no longer see?

For large ecommerce businesses managing thousands of products, where freshness of price, stock, and reviews is paramount, this uncertainty creates risk. The answer isn't to guess what the new algorithms want. Stop trying to predict the future. Experiment to discover it.

From SEO to GEO: What is Generative Engine Optimization?

Generative Engine Optimization (GEO) is the evolution of SEO for the age of AI. It's the practice of optimizing your website not just to rank in a list of links, but to be found, understood, and presented favorably within AI-generated answers and summaries.

While some influence can happen by being part of an AI's slow-moving training data, the real opportunity for dynamic ecommerce sites lies elsewhere. AI models need up-to-the-minute information, which they get by directly accessing URLs and conducting their own searches. This is where you can have an impact right now.

Your goal is to make your product and category pages the most reliable, authoritative, and compelling source of information for the AI as it gathers data to answer a user's query.

How GEO Testing Evolves From SEO Testing

If you're familiar with SEO A/B testing, the core methodology will feel familiar. This isn't about throwing out what works; it's about adapting a proven system for a new reality.

What Stays the Same

  • The Core Mechanism: The scientific approach of using control and variant page groups to measure impact remains the gold standard. You still need statistical rigor to know what truly works.
  • The Testing Ground: Your most important pages - Product Detail Pages (PDPs) and Product Listing Pages (PLPs) - are still the primary focus for optimization.

The Critical Difference: A Focus on the Last Click

The biggest shift is in what you're optimizing for. In traditional SEO, you might test for a higher click-through rate from a list of ten blue links. In GEO, the AI handles much of that initial research. By the time the user reaches your site, they have already read a range of summaries and comparisons.

The click you earn from an AI answer is therefore much further down the funnel. It's often the final, decisive click from a user who is ready to transact. This means your testing focus shifts from top-of-funnel visibility to bottom-of-funnel influence. You're no longer testing against a single search result, but against an entire AI-driven research journey.

How it Works: What Can We Influence?

LLMs present information from two conceptually-different places:

1. Learned Information: Some information is "learned" during the creation of the core model from the original training data and reinforcement learning. In the current state of the art, this is very static knowledge and there is a balance that the providers need to strike between increasing what we might call "intelligence" and "knowledge" in the training of their AI models.

2. RAG (Retrieval Augmented Generation): Fresh, specific, time-sensitive or obscure information and deeper "knowledge" is "piped in" to the model at conversation time as augmented context. This augmentation can come from sources the user specifies, from web searches carried out by the AI system, or from accessing specific web pages sourced from a variety of places.

The slow feedback loop, and batch update nature of changes to models' learned information makes it largely impossible to run statistical tests to isolate all the variables and tell if a particular website change has improved your presence in the training data in such a way that it is more likely to recommend your brand or website without accessing external search data. These step changes (e.g., from GPT-4 to GPT-5) are increases in intelligence more than increases in knowledge, however, and so are mainly independent of our efforts to optimize for AI discovery.

Instead, GEO A/B testing focuses on the ways we can influence the RAG. This is beneficial because:

  • It's real-time - each conversation a user has with the LLM uses the latest search indexes and results behind the scenes
  • It's the primary source of ecommerce influence - the history of Google has taught us all the importance of freshness in commercial queries - price, offers, reviews, ratings, stock levels and more are all real-time data that an AI wouldn't expect to "know" from its training and instead would take from its augmented data

Crucially, the models don't do just a single search. They augment their training with a whole buyer's journey of searches based on a "fan out" set of queries - starting from the user's input prompt and making their own determination of what to research.

Four Levers of GEO Influence

GEO testing can therefore potentially affect four levers of influence:

  1. Ranking for new keywords to increase coverage across the fan-out queries performed by the AI
  2. Ranking better in the search queries performed by the AI
  3. Appearing in a more compelling way in the search results returned to the AI [noting that this process is opaque, and we don't know whether individual products receive just a list of links, information that looks more like a search results page, or full page content for the ranking pages]
  4. Improving the pages themselves so that when the models ingest it, its information is more likely to be included prominently in the output for the user
    • Different products likely carry out this step differently - with Google's Gemini likely getting a more direct feed of page content from Google's index, compared to other tools that are less connected to a search engine provider that may visit the page directly. In the latter case, it's worth remembering that many do not execute JavaScript

Note that the outputs of LLMs don't constitute "search results" in the same way that we are used to, and there isn't the same concept of "ranking" within a conversation. Hypotheses and tests are aimed at a combination of being featured in more conversations, being featured more prominently, or in a more compelling way.

Putting GEO Testing Into Practice: Moving from React Mode to Control Mode

Without a testing methodology, adapting to AI search is just guesswork - you're in React Mode making changes and hoping for the best without a view of the trade-offs between SEO and GEO. GEO testing moves you to Control Mode, allowing you to build a playbook for what actually influences AI-driven traffic and revenue.

The hypotheses are similar in structure, but different in intent. Measurement, tracked through your existing web analytics, is focused on observing uplifts in qualified, high-intent traffic.

Here are two examples of potential GEO tests:

1. Hypothesis for a Product Detail Page (PDP)

Goal: To be the product chosen and recommended in an AI-generated comparison (e.g., "compare the best running shoes for beginners").

Potential Hypothesis: "By reformatting our product specifications into a concise, scannable 'Key Features' summary at the top of the PDP, we hypothesize that generative engines will more frequently cite our product in comparison answers, leading to an increase in qualified last-click traffic."

2. Hypothesis for a Product Listing Page (PLP)

Goal: To become the AI's preferred source for a category-level query (e.g., "where's the best place to buy 4K TVs under Β£1,000?").

Potential Hypothesis: "By adding a clear, authoritative introductory paragraph above the product grid on our category pages, we hypothesize that AI models will use our page as a primary source for 'best of' queries, resulting in more citations and an uplift in high-intent traffic to the entire category."

Stop Trying to Predict the Future. Experiment to Discover it.

The rise of generative AI is the most significant shift in search in two decades. It brings uncertainty, but it also brings opportunity for those prepared to adapt. While your competitors are guessing, you can be learning.

By evolving your SEO testing program to include a GEO testing program as your LLM-powered traffic grows, you can systematically reduce risk and find a competitive advantage.

The world of GEO is new and evolving. The companies that embrace systematic testing and data-driven optimization will be the ones that thrive in this new landscape. With proper tracking and analytics, you can measure what works, iterate on what doesn't, and build a sustainable strategy for AI-powered search.

Tracking Your GEO Performance

One of the biggest challenges in GEO is visibility. Unlike traditional SEO where you can see your rankings, AI search happens in a "black box." This is where comprehensive tracking becomes essential.

To effectively measure GEO performance, you need to track:

  • Citation frequency: How often your brand or products are mentioned in AI-generated answers
  • Query coverage: Which prompts and queries lead to your citations
  • Traffic attribution: Identifying high-intent traffic that originated from AI search
  • Platform differences: Understanding how visibility varies across ChatGPT, Perplexity, Google AI Overviews, and other platforms
  • Content performance: Which pages and content formats drive the most AI citations

Without proper tracking, you're flying blind. You might be getting cited frequently but not know which content is driving it, or you might be missing opportunities because you can't see where you're invisible.

Stop Guessing. Start Testing.

Don't navigate the AI search landscape blind. Conqur AI provides comprehensive tracking and analytics for your brand's visibility across all major AI platforms. See exactly where you're being cited, which queries drive visibility, and how your content performs in AI-generated answers.

Get a Free Demo β†’