I Asked Two AI Agents to Help Me Shop. Here's What They Got Wrong.
AI shopping agents are making purchase recommendations right now. But how accurate are they? We tested ChatGPT and Claude across 5 product categories to find out.
The Experiment
We asked two leading AI agents — ChatGPT and Claude — to help us shop for products across 5 categories: skincare, running shoes, coffee equipment, home office furniture, and kitchen appliances. For each category, we compared their recommendations against actual product availability, pricing, and brand accuracy.
Key Findings
1. Pricing was wrong 60% of the time. AI agents frequently quoted outdated prices. A $38 serum was quoted at $18. A $299 chair was listed at $249. Agents can't access real-time pricing unless sites expose it through structured data or APIs.
2. Discontinued products were recommended. Both agents recommended at least one product that no longer exists in each category. Without product feeds or API access, agents have no way to know what's currently available.
3. Brands with structured data dominated. Sites with complete Schema.org Product markup were mentioned 3x more often than competitors without it. Structured data isn't optional anymore — it's your digital storefront for AI agents.
What This Means for Your Brand
If you're not optimizing for AI agents, you're invisible to a growing segment of shoppers. The brands that show up in AI recommendations are the ones with:
- Complete Product schema markup with current pricing
- Accessible content that doesn't require JavaScript rendering
- Robots.txt that allows AI crawlers
- API or MCP server for real-time data access
Check Your Own Score
Want to know how AI agents see your brand? Run a free scan at pacestack.io and get your Agent Readiness Score in 15 seconds.