AI Agents Quote FAQs You Never Wrote

Shopify now documents a second surface for AI shopping agents: not only the product page, but a set of store FAQs that never appear on your storefront. The Shopify Knowledge Base app says those FAQs are a data source for AI platforms. Auto-generated answers come from your catalog and settings. If shipping, returns, or language settings are thin or wrong, the FAQ the agent quotes can be thin or wrong too.

That is a GEO for marketplace sellers problem on Shopify: the facts an assistant can repeat must live in fields you control, then you check what the Knowledge Base actually generated.

What Shopify says agents read

Shopify’s Optimizing your store for AI page splits the product detail page in two. For people: a clear title, a short summary, price, availability, and images with descriptive alt text. For AI crawlers: specifications, comparison detail, structured attributes, sizing, materials, and care. Extra machine-oriented copy can sit lower on the same page.

Separately, Knowledge Base is a free first-party app. Shopify’s help text is explicit: FAQs are not shown on the online store. They sit behind the scenes so AI shopping agents can answer questions about the business. The app store listing uses the same line: when shoppers ask agents about products or policies, Shopify provides answers from the catalog and settings.

Shopify Product GEO is the listing layer of that work: category metafields, variants, media, and policies. Knowledge Base is the policy-and-FAQ layer on top. Neither layer guarantees a ChatGPT or Google recommendation.

Auto-FAQs are compiled from settings, not invented genius

Shopify lists the sources it uses to generate default facts:

• Language settings
• Customer account settings (returns requests, store credit)
• Shipping and delivery (countries you ship to, pickup)
• Return rules

If those Admin records are incomplete, the default FAQ is incomplete. Shopify’s own managing-FAQs guide tells you to review auto-generated shipping and returns answers, then update the source when the generated content needs improvement, or override the answer.

That is observation, not a ranking claim. Google’s AI features guide still says there is no extra schema for AI Overviews or AI Mode. It does say structured data must match visible text, and Merchant Center information should be current. A Knowledge Base FAQ that contradicts the product page or the shipping profile is a mismatch an assistant can quote.

Merchants already caught invented shipping

This is not a FirstShelf audit. It is public App Store feedback on Shopify’s own app.

On May 13, 2026, an Apple Premium Partner store wrote that pre-generated FAQ answers were “wildly inaccurate”: brands were not pulled from product listings, and one answer claimed worldwide shipping when only two countries were active. On July 23, 2026, another merchant said the query log was useful for returns, warranty, and shipping — the same policy cluster Shopify names as auto-FAQ sources. On July 30, 2026, a third review reported hallucination and limited learning.

Treat those as first-party merchant reports about the app, not a traffic study. They are enough to make the operating rule: read the Default FAQs before you assume agents will describe your catalog correctly.

What to inspect this week

Work in Admin, in this order. Do not start in Search Console.

1. Fix the sources auto-FAQs compile from

Open Settings > Shipping and delivery and confirm the countries and pickup options you actually offer. Open Settings > Policies (and return rules) and make the window, final-sale, and restocking facts match what you honor. Knowledge Base tells you to update the source when generated content is wrong. Overriding one FAQ without fixing shipping settings leaves the next default answer stale.

2. Put comparable facts on the product, not only in a FAQ

On each product, fill the surfaces Shopify’s AI page names: title, description, attributes, sizing or materials, care, price, availability, and image alt that describes the photo. Category metafields and variants are the Shopify Product GEO work. A Knowledge Base answer cannot invent a fiber content or a chest measurement that the listing never states.

3. Open Apps > Knowledge Base

Install the free app if it is missing. In Store FAQs, filter Default. Open shipping, returns, and language answers. If an auto-FAQ is wrong, click Override, write a 1–2 sentence correction, and save. Shopify says you cannot delete auto-generated FAQs; you override them or fix the source. Return to default if you want the compiled answer back.

4. Add only the questions a listing cannot answer

Use Add FAQ for store-level facts agents ask and the PDP does not carry: restock timing, warranty, made-to-order lead time, which countries you refuse. Keep answers to one or two sentences, as Shopify’s form expects. Do not paste a 400-word policy.

5. Test before you trust it

Use Test your knowledge base. Ask “Do you ship to [country]?” and “What is the return window for [product type]?” Shopify shows Matched to a resource, Unanswered, or multiple matches. Unanswered means add a FAQ. A match to the wrong resource means override or fix settings.

What this does not claim

Knowledge Base does not rank you in Google AI Mode. Shopify does not publish a count of agents that will quote your FAQs. Google does not say a Knowledge Base entry is a ranking factor. FirstShelf’s 90-day audit sample is too small to cite here.

The honest job is narrower: stop an assistant from repeating a default FAQ that your shipping profile never supported.

How FirstShelf can help

FirstShelf runs a controlled Buyer Match check on the listing you submit: buyer question, evidence on the product, then a truthful Shopify field to review. It does not connect to Admin, does not edit Knowledge Base, and does not promise an AI recommendation. Use it to see which product facts are still missing before you override FAQs that were compiled from those same facts.