AsAISeesItAs AI Sees It
Guides

How to check what ChatGPT says about your Shopify store

4 min read

Want a starting point? Get your free visibility score. Enter your store URL to check how readable your store is to AI. It takes about a minute. Then use the test below to see what the assistants say.

You have heard shoppers are asking ChatGPT what to buy. Does it ever mention your store? When it does, does it describe you correctly?

Set aside about 15 minutes for a first pass. Ask the questions a shopper would ask before they know your name, then repeat them later to see whether the answers change.

Why self-tests can give the wrong answer

Using your store name answers a different question. "Is Wild Fig & Co. a good candle shop?" tests whether ChatGPT can find information about that shop. A shopper who has never heard of it might ask "best soy candle gift under $40". That tests whether the store gets recommended without a nudge.

Wild Fig & Co. is a made-up example store.

Asking once is another problem. AI answers change between runs. The same question can name your store in one answer and skip it in the next. Keep the first answer, but don't treat it as a verdict.

Step 1: Write five shopper questions without your name

Think about what a buyer types before they know you exist. Try questions that include a budget, a need or a delivery location:

  • "Best linen bedding under $200"
  • "Gift for a coffee lover who has everything"
  • "Non-toxic candle for a small apartment"
  • "Handmade jewellery shop that ships to Canada"
  • "Brand A vs smaller alternatives for wool socks"

Use questions that fit what you sell. Leave your store name and domain out, and save the exact wording so you can repeat the test.

Step 2: Ask in a clean session, more than once

Open ChatGPT in a temporary chat, or log out, to reduce the influence of your previous conversations. Ask each question, then repeat each one later in the day.

For each answer, note whether your store was named, which other stores appeared and which source pages ChatGPT linked to. Save the links too. They help you see where a description came from.

Step 3: Ask the other assistants too

Run the same five questions in Gemini, Claude and Perplexity. Your store might appear in one assistant's answer and be missing from another's. Record the difference. One assistant's answer doesn't tell you what all the others will say.

As AI Sees It checks ChatGPT, Gemini, Claude and Perplexity.

Step 4: Ask what it knows about you by name

Now use your store name. Start a fresh session and ask:

  • "What does [your store name] sell?"
  • "Who is [your store name] for, and what is their price range?"
  • "What is [your store name]'s return policy?"

Compare each answer with the facts on your store. Look for old prices, discontinued products or a return policy you don't offer. These mistakes can point to missing or outdated information, although an assistant can also get the facts wrong.

The methodology page explains how As AI Sees It reads your positioning and where its checks have limits. If the description of your store is wrong, review the pages behind it.

Step 5: Write down what you see

Use a spreadsheet with a row for each question and a column for each assistant. Add the date and keep the answers from each round separate.

For the made-up Wild Fig & Co. example, a note might read: "Best soy candle gift under $40, ChatGPT: store not named; Perplexity: store named, product page cited." That records what happened without turning one answer into a score.

After two rounds, compare the results. Look for repeated omissions or descriptions, but keep the differences between runs visible.

What your results can tell you

Your store is missing, and answers about it are wrong

Start with your About page, shipping and returns pages, and product descriptions. State the facts a shopper needs. Shopify's Optimizing your store for AI guide recommends detailed specifications, comparison information, structured data and product attributes, plus sizing, material and care details where they apply.

Your store is missing from ChatGPT but appears elsewhere

Check your Shopify admin under Sales channels > Agentic. Why isn't my Shopify store showing up in ChatGPT? walks through the settings and other possible reasons.

Your store is described correctly but rarely recommended

Other stores may be a closer match for the questions you asked. Read How to get your Shopify store recommended by ChatGPT and compare the information on your pages with the questions in your test.

People visit from AI answers but don't buy

Check what happens between the recommendation and the page they reach. ChatGPT sends me traffic, so why aren't they buying? covers that next step.

The limits of a hand test

Your questions are guesses about what shoppers ask. They don't give you reliable prompt search volumes.

Consumer apps can use memory and location, so your answer and a shopper's answer may differ. A temporary chat reduces some personal context; it doesn't make every test identical.

Fixing your pages can help assistants understand your store. It cannot guarantee a recommendation.

Check your store's readable pages

The free visibility score at asaiseesit.com checks whether AI crawlers are allowed in your robots.txt, along with Product schema, price and availability fields, brand, GTIN or MPN, and product copy. It also checks your shipping, returns and About pages.

It takes about a minute. Use it alongside your hand test: the score checks what AI can read, while your saved answers show what the assistants said in those sessions. Read how we check, and what we can't know for the limits.

Get my free visibility score

See how AI sees your store

Find out if ChatGPT and other AI assistants find your store, what they say about you and who they recommend instead. Free, in about a minute, and every finding comes with a fix.