AI Crawler Log Analyzer
Upload your server access logs and see exactly which AI crawlers visit, how often, and which pages they fetch. The clearest signal of how AI engines are consuming your content.
AI Visibility Intelligence
The fastest way to answer: are AI engines even seeing your site?
You can measure brand mentions in ChatGPT or Perplexity, but crawl behaviour is the earliest signal. If no AI bot has fetched your pages, no AI engine can cite them. If GPTBot is crawling 500 pages/day but Perplexity-User isn't fetching anything, your training visibility is on but your real-time answer visibility is off. All processing happens in your browser.
Upload log file
🤖
Drop log file here or click to upload
Apache Combined / Nginx format · Up to 50MB · Nothing leaves your browser
or paste below
Next steps
Track what AI engines say about you
SEORCE AI Beacon tracks your brand across 7 AI engines + Google AI Overview, AI Mode & Search, with the exact page behind each citation.
Frequently asked questions
What logs does this tool accept?
Standard web server access logs: Apache combined format, Nginx default, or Cloudflare log push format. The tool auto-detects.
What should I learn from AI crawler logs?
Which AI bots are visiting, how often, which pages they request, and whether they're being served the right content. Also: which bots are hammering your origin and should be rate-limited.
How do I get server logs from a managed host?
Shopify, Webflow, and most SaaS CMSes don't expose raw logs. Use Cloudflare Logpush (available on Business plans) or your CDN's log export. For VPS-hosted sites, logs are at
/var/log/nginx/ or /var/log/apache2/.What user-agents does the tool recognise?
GPTBot, ChatGPT-User, ClaudeBot, Claude-Web, PerplexityBot, Google-Extended, Googlebot-AI, Bytespider, CCBot, Amazonbot, Applebot-Extended, Meta-ExternalAgent, and about 20 more.
How can I tell a real AI crawler from a spoofed one?
Reverse-DNS lookup on the IP. Real GPTBot requests come from
crawl-*.openai.com. ClaudeBot from Anthropic's IP range. Spoofed user-agents won't pass reverse DNS.What crawl rate is normal?
For a 10,000-page site, GPTBot typically hits ~200 to 500 pages per week. PerplexityBot can be much higher if the site is cited often. Over 10,000 hits a day from one bot is unusual.
What should I do with the crawl report?
Pages hit most are what AI engines consider most important on your site. Pages never hit may need internal linking or inclusion in llms.txt. Pages hit but returning 404s are missed opportunities.
Does the tool store my logs?
No. Analysis runs entirely in your browser. Nothing is uploaded. Reload the page and the data is gone.
Can I upload Cloudflare log files directly?
Yes. Cloudflare Logpush JSON and NDJSON formats are supported. Enterprise log formats work too.
What file size can the browser handle?
Up to about 100MB uncompressed on a modern laptop. For larger logs, split by day or filter server-side first.
Are AI crawler hits counted as traffic in GA4?
No. GA4 only runs on JavaScript loads, so most bots are excluded. These logs are the only way to see AI crawler activity.
Free · no account
SEORCE for Chrome, Edge and Firefox
Audits the page you are on: headings, meta tags, schema, indexability, and whether AI crawlers can read it. Export the result as a PDF. Free, with no account.
It audits one page at a time and does not track AI answers. About the extension
Where you stand in AI answers
This tool checks the inputs. AI Beacon shows the answers.
SEORCE AI Beacon tracks whether your brand is named and cited across 7 AI engines + Google AI Overview, AI Mode & Search. It shows the exact page behind each citation, and whether it was cited or only consulted.
3,000+ users · Free forever plan, no card needed