SEORCEBOT

SEORCEBot, the SEORCE crawler.

SEORCEBot fetches pages when a SEORCE user audits a site or checks an AI citation. This page explains how it identifies itself, what it collects and how to control it.

How to recognise it

The user agent.

Every request from SEORCEBot carries this user agent string.

Mozilla/5.0 (compatible; SEORCEBot/1.0; +https://seorce.com/bot)

The address in the string, seorce.com/bot, leads to this page.

How it behaves

Polite by default.

Follows robots.txt

SEORCEBot respects robots.txt by default. A SEORCE user can switch this off for a specific audit.

Crawls on demand

It fetches pages when a SEORCE user runs an audit or checks an AI citation, and stops once it has the data that audit needs.

Paces its requests

It leaves a delay between requests to keep the load on your server low.

Reads public pages

It collects page metadata, content, schema markup and other on-page signals. It does not collect personal data beyond what is publicly available on the page.

How to control it

Your site, your rules.

Add rules for SEORCEBot to your robots.txt file. You can also control it through HTTP headers, or ask us to change its access to your site.

# Keep SEORCEBot off the whole site
User-agent: SEORCEBot
Disallow: /

# Or keep it out of one folder
User-agent: SEORCEBot
Disallow: /private/
Questions

If it causes trouble, tell us.

If SEORCEBot is causing a problem on your site, email us and we will look into it.