How to Set Up Shopify Knowledge Base and Keep AI Answers Accurate

You’ve updated your return policy, clarified your international shipping terms, or added warranty information to your website. Yet a customer may still receive outdated information about your store from an AI assistant.

The reason is that AI shopping agents rely not only on the content of individual pages, but also on structured data about your store, products, and settings. Shopify Knowledge Base lets you review automatically generated FAQs, correct their answers, and add your own questions and answers for AI agents to use when handling customer queries.

In this guide, we’ll show you how to install and configure Knowledge Base, override automatically generated answers, and test how it works without risking confusing your customers.

Step 1. Install Knowledge Base and find it in your admin

Shopify Knowledge Base is an official Shopify tool:

1. In your Shopify admin, go to Apps and search for Shopify Knowledge Base (or find it in the Shopify App Store).
2. Click Install and confirm the installation.
3. Once installed, the app will be available directly in your admin under Apps → Knowledge Base.

Step 2. Review and override Default FAQs

Right after installation, Shopify automatically generates basic facts about your store based on your current policies, shipping profiles, and locations. This is where outdated or inaccurate information is most likely to appear.

1. Open Apps → Knowledge Base.
2. Go to the Store FAQs tab.
3. Use the filter at the top to select Default. This section contains answers generated automatically by the system.
4. Find the FAQ where the information no longer matches your actual policies, such as Return Policy or Shipping Terms.
5. Open the question and click Override.
6. Enter your approved policy or guidance in a concise form (1–2 sentences, with no vague or generic wording), then click Save.

Important: Automatically generated FAQs cannot be deleted. If the information is incorrect, update the underlying store data or open the FAQ and use Override to provide your own answer.

Step 3. Add Custom FAQs

If customers frequently ask about product-specific details, such as sizing, component compatibility, or what’s included, add clear answers manually:

1. In the Store FAQs section, click Add FAQ.
2. In the Question field, enter the question in simple, natural language, as a customer would ask it (for example: How do I choose the correct size? or What is included with the product?).
3. In the Answer field, provide a clear answer and include a direct link to the relevant section of your store or your support email (for example, support@yourstore.com).
4. Click Save.

Step 4. Test your knowledge base using FAQ query log

To check how Knowledge Base matches customer questions to available sources and make sure it isn’t relying on duplicate or outdated information, test your knowledge base directly from the admin:

1. Inside the Knowledge Base app, open Test your knowledge base (under FAQ query log → View full log and test queries).
2. Enter a question in the test field, such as What is your return policy? or Can I return an item?.
3. Check the matching status:
   • Matched: The system found a resource that may contain an answer to the question. Check that the source is an up-to-date FAQ or current store information.
   • Unanswered: No suitable source was found for the question. In this case, review the wording and create a dedicated FAQ if necessary.

Quick pre-launch checklist:

• Automatically generated Default FAQs have been reviewed.
• Outdated answers have been updated using Override, or their underlying sources have been corrected.
• Custom FAQs contain short, clear, and unambiguous answers.
• Common and alternative versions of customer questions have been tested using Test your knowledge base.
• Required Custom FAQs have been added for questions with no matching source.
• New customer questions are reviewed regularly in the FAQ query log.

Knowledge Base is more than just a place to manage your FAQs. Once your store starts appearing in AI shopping conversations, the app can show you which questions customers are asking, which ones are being answered, and which remain unanswered. This makes the Query Log a useful source of ideas for new FAQs.

The more accurate and up to date your Knowledge Base is, the less likely it is that customers will receive incomplete or outdated information about your store from an AI assistant.

Want to prepare your store for AI search?

AI visibility depends on more than the content published on your store pages. Your product information, purchasing terms, and store details also need to be structured correctly and made accessible to AI systems.

If you want to assess how ready your Shopify store is for AI search, message us at @icestoregroupshopify. We’ll review your store structure, catalog data, and the areas that may affect how your store appears in AI shopping experiences.