AI search tools cite fake content when new posts appear on sources they already trust, and Search Engine Journal reported on October 19, 2026 that four major tools cited a fabricated concept within seven days. The finding comes from Fudan University researchers, whose paper was posted on arXiv on October 8 after tests in March and April.
The tested English-web tools were ChatGPT, Perplexity, Grok and a system the paper labels Google AI, according to Search Engine Journal. The paper does not specify which Google product was tested, and that matters because Google Search AI Overviews, AI Mode and other Google AI surfaces do not have identical interfaces or citation behavior.
Why AI search tools cite fake content
AI search tools cited the fake concept because the researchers placed new pages on sites those tools already used as citation sources. In March, the Fudan team ran 120 questions through 10 AI search tools and recorded each tool's most-cited sites. Reddit was the most-cited site for Google AI and Grok, YouTube for Perplexity, and Wikipedia for ChatGPT, according to Search Engine Journal's account of the paper.
AI search citation risk is mostly a source-selection problem. The Fudan tests show that when fabricated material lands on a platform an AI search system already cites, the system can surface that material before independent verification exists. The paper shows that for one invented concept, not for every query class or every brand query.
The researchers then posted articles about the fictional Cactus Gravity Protocol, an opinion question about whether AI would supplant junior programmers inside five years, and a fictional keyboard. All four English-web tools cited the Cactus Gravity Protocol posts within a week. From the first day each tool cited the posts through day seven, Grok linked to a post in 30 of 32 answers, Google AI in 15 of 33, Perplexity in 13 of 35, and ChatGPT in 7 of 20.
Why placement beat posting volume
Placement beat volume because posts on frequently referenced sources were cited before posts on rarely referenced sites in the Fudan tests. The researchers created paired postings about five relatively unknown vacation destinations. In every case, the post on the frequently referenced source produced the first reference, citation or planted detail, according to Search Engine Journal.
The lesser-referenced side did not perform the same way. Search Engine Journal reported that the best case on the lesser-referenced side required 20 postings, and 40 postings on a self-hosted WordPress site produced zero references within seven days. In a separate Sohu posting experiment, total citations across all 10 tools increased from 24 to 128 as posting volume rose, but the researchers described that as an association because each volume used a different fictional subject.
What the tests do not prove
The tests do not prove that fake brand claims, product claims or competitive claims will enter AI answers at the same rate. Search Engine Journal notes that none of the posted topics was a real brand or product. The paper also does not isolate which variable caused the Cactus Gravity Protocol to travel farther than the opinion prompt or the fictional keyboard, because topic, competition and question type changed together.
The evidence is also thin on Google-specific conclusions. The Fudan paper uses the label Google AI and links to Google's general AI site, but it does not say which Google product was queried. Search Engine Journal also reported that Google's guide to AI features says seeking inauthentic mentions is not as helpful as it might seem, and that Google clarified on May 15 that its spam policies cover attempts to manipulate generative AI responses in Google Search.
Practitioner behavior adds another weak point. In the r/aiwars discussion posted on October 23, 2026, commenters did not provide authoritative evidence, but several described the same operational concern: users may accept AI summaries without opening the cited source. One commenter said AI can be useful for research if the user asks for links to reports or studies and then reads the source material.
How to check your own exposure
Teams should check AI citation exposure by product, prompt, model, page and site, because one prompt run can hide the problem. The best supported action is measurement discipline, not mass posting. The October 18 Search Engine Journal report on a separate paper from the National University of Singapore and Xi'an Jiaotong University found that Google results and OpenAI's Responses API together found only 26.2% of pages cited by ChatGPT's GPT-5.5 Instant setting.
| Check | What to record | Why it matters |
|---|---|---|
| AI product | ChatGPT web app, Perplexity, Grok, Google AI surface | The Fudan paper's Google label is not specific enough for audit conclusions. |
| Prompt runs | Same prompt repeated across dates and sessions | The ChatGPT citation paper found large run-to-run variation in cited pages. |
| Citation level | Exact URL and domain or subdomain | The OpenAI API and Google results matched sites more often than pages. |
| Source type | Owned page, user-generated profile, forum post, video page | The Fudan tests found placement on frequently cited sources mattered. |
| Policy risk | Any paid posting package or planted mention campaign | Google's May 15 clarification covers attempts to manipulate generative AI responses in Google Search. |
Monitoring AI visibility through one API result or one manual prompt run is not enough. The separate ChatGPT citation paper found that sources changed between runs and that stand-ins matched sites more often than exact pages. A useful audit records the product, model setting, prompt wording, date, cited URL and cited site.
What this means for search visibility
The search visibility implication is that AI citation monitoring should treat user-generated platforms as possible answer sources, not only as reputation channels. That is an inference from the Fudan results, because the paper did not test commercial SERPs for brand terms. Still, the named entities in the test matter for marketers: Reddit, YouTube, Medium, GitHub, LinkedIn, Facebook and Sohu were evaluated as posting or citation environments.
The paid media connection is narrower. The evidence does not show that Google Ads bidding, auction price, Quality Score or sponsored placement changed because of AI citations. What it does show is that organic answer systems may cite pages that paid search teams do not monitor, so brand safety checks around campaign launches should include AI answers for the exact product name, category claim and comparison wording used in ads.
For content teams, the operational lesson is to watch where AI systems cite, not only where Google ranks a page. The October 18 Search Engine Journal report said ChatGPT rewrote user questions into its own searches and never used the exact original wording in visible searches for GPT-5.3 Instant and GPT-5.5 Instant runs. That means a rank tracker built around exact query strings may miss the source paths ChatGPT used.
What happens next
The next trigger is model and product change. Search Engine Journal reported that the ChatGPT citation paper's settings predate GPT-5.6 and GPT-6, and that OpenAI says GPT-6 is rolling out in Chat to eligible Plus, Pro, Business and Enterprise users while GPT-5.6 Luna becomes the default for Free and Go users. Re-run citation audits when the model behind the answer changes, and watch for any revised Fudan paper after the researchers' disclosures to ChatGPT, Perplexity, Google AI and the other tested platforms.

