Skip to content
1See where you stand
AI BeaconYour brand across 7 AI engines and Google AI Rank TrackerGoogle and Bing positions, by country Keyword Explorer87M+ keywords with volume and intent BacklinksEvery linking domain, scored from 0 to 100
2Fix what holds you back
Technical SuiteCrawl your site and find what's broken AutoFixPart of Technical Suite. Fixes applied on your live site. Content StudioContent in your brand voice, ready to publish
3Measure the uplift
Web AnalyticsVisits from search and AI, in one view Reports & DashboardsCustom dashboards and scheduled reports
On top of every engine
Ask SEORCEBetaYour AI agent. Ask about your project in the app or on WhatsApp.
Free to use
Browser extension Free tools API reference
Every engine reads the same project data.See the full platform →
By team
EnterpriseMany sites and markets, one method Global brandsYour brand in search and AI answers AgenciesA project for each client, priced per project ConsultantsRun client work from one account E-commerceProduct and category pages buyers can find D2C brandsVisibility for brands that sell direct B2B & SaaSBe there while buyers research
By industry
Automotive Baby & kids Beauty Consumer electronics Education Energy & utilities Fashion Financial services FMCG Food & beverage Health & wellness Healthcare Home & furniture Insurance IT services Legal Logistics Luxury Manufacturing Marketplaces Media & publishing Multi-location brands Pharma Professional services Real estate Sports & entertainment Telecom Travel & hospitality
A project for each site or market.See all solutions →
Learn
BlogGuides and notes from our team FeedAI and SEO news, as it moves The GEO guideGenerative engine optimisation, start to finish
Get the job done
Use casesHow to get a job done, topic by topic PlaybooksWhat to do when things change
AI visibility tracking Automated technical SEO Recover from a traffic drop Prove SEO ROI to leadership
Free resources
Free toolsSchema and content brief generators, and more Browser extensionFor Chrome, Edge and Firefox. Audits the page you're on, free.
Help and updates
Docs API API reference Changelog
Enterprise
Pricing
Log in Book a demo Start free
Platform
See where you stand
AI Beacon Rank Tracker Keyword Explorer Backlinks
Fix what holds you back
Technical Suite AutoFix (in Technical Suite) Content Studio
Measure the uplift
Web Analytics Reports & Dashboards
On top of every engine
Ask SEORCE (beta)
Free to use
Browser extension Free tools See the full platform →
Solutions
By team
Enterprise Global brands Agencies Consultants E-commerce D2C brands B2B & SaaS
By industry
Automotive Baby & kids Beauty Consumer electronics Education Energy & utilities Fashion Financial services FMCG Food & beverage Health & wellness Healthcare Home & furniture Insurance IT services Legal Logistics Luxury Manufacturing Marketplaces Media & publishing Multi-location brands Pharma Professional services Real estate Sports & entertainment Telecom Travel & hospitality See all solutions →
Resources
Learn
Blog Feed: AI and SEO news The GEO guide
Get the job done
Use cases Playbooks AI visibility tracking Automated technical SEO Recover from a traffic drop Prove SEO ROI to leadership
Free resources
Free tools Browser extension
Help and updates
Docs API API reference Changelog
Company
About us Careers Contact Partners Alternatives Comparisons SEORCEBot, our crawler Legal
Enterprise Pricing
Book a demo Start free Have an account? Log in
Theme
SEORCE. The source. An AI-native SEO and GEO platform for mid-market and enterprise brands, and the agencies that serve them.
#1 on Product Hunt
NVIDIA Inception member
Platform
  • AI Beacon
  • Keyword Explorer
  • Content Studio
  • Technical Suite
  • Backlinks
  • Rank Tracker
  • Web Analytics
  • Reports & Dashboards
  • Ask SEORCE · beta
Solutions
  • For B2B & SaaS
  • For e-commerce & D2C
  • For agencies
  • For global brands
  • For enterprise
  • All industries
Learn
  • Use cases
  • Playbooks
  • Blog
  • Feed
  • Browser extension
  • Free tools
  • Docs
  • API
  • API reference
  • Changelog
Company
  • Pricing
  • Alternatives
  • Comparisons
  • Partners
  • About us
  • Careers
  • Contact
  • SEORCEBot
  • Book a demo
  • Legal
© 2026 SEORCE, Inc. · Delaware, US · All rights reserved
Privacy Terms Cookies Billing & refunds

Cookies on seorce.com

We use cookies the site needs to work. With your permission we would also like to use analytics cookies to see how the site is used, and marketing cookies to measure our ads. You can change your choice at any time from Cookie preferences at the foot of every page. Read the cookie policy.

Your browser is sending a Global Privacy Control signal, so marketing cookies stay off.

Strictly necessaryRemember your theme and this choice. Always on.
On
Published Oct 23, 2026•by SEORCE Editorial, Search and marketing desk

AI search tools cite fake content from trusted sources

Four tools cited a fabricated concept within seven days in Fudan University tests posted on arXiv.

Add as a preferred source on Google

TL;DR

  • Fudan University researchers found that ChatGPT, Perplexity, Grok and Google AI cited a fabricated concept within seven days.
  • Placement on frequently cited user-generated sites beat posting volume in the reported tests of AI search citation behavior.
  • Google clarified on May 15 that its spam policies cover attempts to manipulate generative AI responses in Google Search.
  • ChatGPT citation monitoring can miss page-level results when teams rely on one API query or one prompt run.
Laptop showing search results beside printed pages and sticky notes on a desk

AI search tools cite fake content when new posts appear on sources they already trust, and Search Engine Journal reported on October 19, 2026 that four major tools cited a fabricated concept within seven days. The finding comes from Fudan University researchers, whose paper was posted on arXiv on October 8 after tests in March and April.

The tested English-web tools were ChatGPT, Perplexity, Grok and a system the paper labels Google AI, according to Search Engine Journal. The paper does not specify which Google product was tested, and that matters because Google Search AI Overviews, AI Mode and other Google AI surfaces do not have identical interfaces or citation behavior.

Why AI search tools cite fake content

AI search tools cited the fake concept because the researchers placed new pages on sites those tools already used as citation sources. In March, the Fudan team ran 120 questions through 10 AI search tools and recorded each tool's most-cited sites. Reddit was the most-cited site for Google AI and Grok, YouTube for Perplexity, and Wikipedia for ChatGPT, according to Search Engine Journal's account of the paper.

AI search citation risk is mostly a source-selection problem. The Fudan tests show that when fabricated material lands on a platform an AI search system already cites, the system can surface that material before independent verification exists. The paper shows that for one invented concept, not for every query class or every brand query.

The researchers then posted articles about the fictional Cactus Gravity Protocol, an opinion question about whether AI would supplant junior programmers inside five years, and a fictional keyboard. All four English-web tools cited the Cactus Gravity Protocol posts within a week. From the first day each tool cited the posts through day seven, Grok linked to a post in 30 of 32 answers, Google AI in 15 of 33, Perplexity in 13 of 35, and ChatGPT in 7 of 20.

Why placement beat posting volume

Placement beat volume because posts on frequently referenced sources were cited before posts on rarely referenced sites in the Fudan tests. The researchers created paired postings about five relatively unknown vacation destinations. In every case, the post on the frequently referenced source produced the first reference, citation or planted detail, according to Search Engine Journal.

The lesser-referenced side did not perform the same way. Search Engine Journal reported that the best case on the lesser-referenced side required 20 postings, and 40 postings on a self-hosted WordPress site produced zero references within seven days. In a separate Sohu posting experiment, total citations across all 10 tools increased from 24 to 128 as posting volume rose, but the researchers described that as an association because each volume used a different fictional subject.

What the tests do not prove

The tests do not prove that fake brand claims, product claims or competitive claims will enter AI answers at the same rate. Search Engine Journal notes that none of the posted topics was a real brand or product. The paper also does not isolate which variable caused the Cactus Gravity Protocol to travel farther than the opinion prompt or the fictional keyboard, because topic, competition and question type changed together.

The evidence is also thin on Google-specific conclusions. The Fudan paper uses the label Google AI and links to Google's general AI site, but it does not say which Google product was queried. Search Engine Journal also reported that Google's guide to AI features says seeking inauthentic mentions is not as helpful as it might seem, and that Google clarified on May 15 that its spam policies cover attempts to manipulate generative AI responses in Google Search.

Practitioner behavior adds another weak point. In the r/aiwars discussion posted on October 23, 2026, commenters did not provide authoritative evidence, but several described the same operational concern: users may accept AI summaries without opening the cited source. One commenter said AI can be useful for research if the user asks for links to reports or studies and then reads the source material.

How to check your own exposure

Teams should check AI citation exposure by product, prompt, model, page and site, because one prompt run can hide the problem. The best supported action is measurement discipline, not mass posting. The October 18 Search Engine Journal report on a separate paper from the National University of Singapore and Xi'an Jiaotong University found that Google results and OpenAI's Responses API together found only 26.2% of pages cited by ChatGPT's GPT-5.5 Instant setting.

CheckWhat to recordWhy it matters
AI productChatGPT web app, Perplexity, Grok, Google AI surfaceThe Fudan paper's Google label is not specific enough for audit conclusions.
Prompt runsSame prompt repeated across dates and sessionsThe ChatGPT citation paper found large run-to-run variation in cited pages.
Citation levelExact URL and domain or subdomainThe OpenAI API and Google results matched sites more often than pages.
Source typeOwned page, user-generated profile, forum post, video pageThe Fudan tests found placement on frequently cited sources mattered.
Policy riskAny paid posting package or planted mention campaignGoogle's May 15 clarification covers attempts to manipulate generative AI responses in Google Search.

Monitoring AI visibility through one API result or one manual prompt run is not enough. The separate ChatGPT citation paper found that sources changed between runs and that stand-ins matched sites more often than exact pages. A useful audit records the product, model setting, prompt wording, date, cited URL and cited site.

What this means for search visibility

The search visibility implication is that AI citation monitoring should treat user-generated platforms as possible answer sources, not only as reputation channels. That is an inference from the Fudan results, because the paper did not test commercial SERPs for brand terms. Still, the named entities in the test matter for marketers: Reddit, YouTube, Medium, GitHub, LinkedIn, Facebook and Sohu were evaluated as posting or citation environments.

The paid media connection is narrower. The evidence does not show that Google Ads bidding, auction price, Quality Score or sponsored placement changed because of AI citations. What it does show is that organic answer systems may cite pages that paid search teams do not monitor, so brand safety checks around campaign launches should include AI answers for the exact product name, category claim and comparison wording used in ads.

For content teams, the operational lesson is to watch where AI systems cite, not only where Google ranks a page. The October 18 Search Engine Journal report said ChatGPT rewrote user questions into its own searches and never used the exact original wording in visible searches for GPT-5.3 Instant and GPT-5.5 Instant runs. That means a rank tracker built around exact query strings may miss the source paths ChatGPT used.

What happens next

The next trigger is model and product change. Search Engine Journal reported that the ChatGPT citation paper's settings predate GPT-5.6 and GPT-6, and that OpenAI says GPT-6 is rolling out in Chat to eligible Plus, Pro, Business and Enterprise users while GPT-5.6 Luna becomes the default for Free and Go users. Re-run citation audits when the model behind the answer changes, and watch for any revised Fudan paper after the researchers' disclosures to ChatGPT, Perplexity, Google AI and the other tested platforms.

See more SEORCE in your Google results

Add us as a preferred source to see more of our stories in Google's Top Stories.

Add as a preferred source on Google

FAQ

Can AI search engines cite fake pages?

Yes, AI search engines can cite fake pages in some conditions. In the Fudan University tests reported by Search Engine Journal, ChatGPT, Perplexity, Grok and Google AI cited posts about the fictional Cactus Gravity Protocol within seven days of publication.

Which AI tools cited the fake concept?

ChatGPT, Perplexity, Grok and Google AI all cited the fake concept in the reported English-web tests. The Google result is the least specific because the paper used the label Google AI without naming the exact Google product tested.

Does posting more content make AI tools cite it?

Posting more content did not prove causation in the reported tests. The Fudan researchers saw more citations in one Sohu volume experiment, but they described the relationship as an association because the subjects differed across volume levels.

How should I track ChatGPT citations?

Track ChatGPT citations by repeating prompts and saving exact cited URLs. The separate citation paper reported by Search Engine Journal found that API and Google-result stand-ins matched ChatGPT sites better than exact pages, so page-level monitoring matters.

Is buying AI mention placement against Google rules?

Google has said its spam policies cover attempts to manipulate generative AI responses in Google Search. The evidence does not describe enforcement rates, but paid posting packages created enough risk that teams should log and review any artificial mention campaign.

Entities

ChatGPTGrokFudan UniversityarXiv

Tags

AI SearchCitation RiskFake ContentSearch VisibilityGenerative AIContent AuditsGoogle AI

Topics

SEOArtificial Intelligence

Sources

AI Search Tools Cited A Made-Up Concept Within A Week, Paper Finds via @sejournal, @MattGSouthern
Search Engine Journal
OpenAI’s API Only Partly Matched ChatGPT’s Citations, Paper Finds via @sejournal, @MattGSouthern
Search Engine Journal
What's wrong with using AI to do research? It's just like using Google like it used to be but now it's more efficient
r/aiwars

More like this