Skip to content
Modelwire
Subscribe

ChatGPT and Gemini steer shoppers toward fake retail sites

Source published ·Modelwire updated

Original coverage: The Verge - AI ↗·How Modelwire adds context

The development

A new study from IP protection firm Podqi reveals that major LLM chatbots including ChatGPT, Gemini, and Perplexity are directing users to fraudulent retail websites when answering shopping queries. This finding exposes a critical vulnerability in how generative AI systems handle real-world commerce recommendations, where hallucinated or poisoned training data can create genuine consumer harm. The incident underscores a growing tension between LLM deployment at scale and the systems' inability to reliably distinguish legitimate vendors from imposters, raising questions about liability and the readiness of production AI for high-stakes recommendation tasks.

Modelwire’s AI-generated summary of coverage from The Verge - AI.

Modelwire analysis

Analyst take

Our AI-generated reading of the wider context and the next developments to watch.

The study doesn't just document hallucination; it reveals that LLMs are confidently directing real users to fraudulent vendors at scale. This matters because it creates concrete liability exposure for platforms monetizing commerce recommendations, not just reputational risk.

OpenAI launched Business Agents and a ChatGPT business directory on November 10th, positioning the platform as a verified commerce layer where brands register and deploy AI to handle transactions. Two days later, this study shows the underlying models cannot reliably distinguish legitimate from fake vendors. The timing exposes a critical gap between OpenAI's monetization roadmap and the safety infrastructure required to execute it. Unlike the mental health auditing work from November 9th (which flagged inconsistency across contexts), this problem is not about variance in tone or hedging; it's about direct consumer fraud. OpenAI is building a commission-based marketplace on infrastructure that demonstrably fails at the core task of vendor verification.

If OpenAI announces mandatory verification requirements or third-party vetting for Business Agents within 30 days, that signals they're treating this as urgent. If they don't, watch whether Podqi's findings trigger FTC inquiry into unfair or deceptive practices in ChatGPT's commerce recommendations by Q1 2027.

This interpretation is generated from the summary above and the archive coverage cited below. Our methodology · Report an error

Coverage behind this analysis

These archive entries ground the connection in our analysis. They are ordered by source publication date, with links to our coverage and the original sources.

  1. ·The Verge - AI

    OpenAI launches verified business agents within ChatGPT for e-commerce

    OpenAI is expanding ChatGPT's commercial utility by introducing verified Business Agents, a new layer of branded intermediaries within the chat interface. These agents will handle transactional workflows like product comparison and customer service for eligible US e-commerce and service providers. The move signals a strategic pivot toward embedding LLMs deeper into commerce workflows while creating…

    Read Modelwire coverage →Original source ↗

MentionsChatGPT · Gemini · Perplexity · Podqi · The Verge

MW

How this coverage is produced

Modelwire uses AI to generate summaries and context from source headlines, snippets, and selected archive coverage. Automated checks do not verify every claim, and items are not routinely reviewed by a person before publication. Zacaria Solis operates the site. Read the linked source for the full evidence and report errors through our corrections process.

Modelwire summarizes, we don’t republish. The Verge - AI originally reported this story as “AI chatbots are recommending fake retail websites, study finds”. The full content lives on theverge.com. If you’re a publisher and want a different summarization policy for your work, see our takedown page.

More to explore

OpenAI launches verified business agents within ChatGPT for e-commerce

OpenAI and Shopify enable direct business profiles in ChatGPT

OpenAI launches ChatGPT Wallet to compete in AI agent commerce

The Decoder·
ChatGPT and Gemini steer shoppers toward fake retail sites · Modelwire