seedciteSeedciteAuditBot
SeedciteAuditBot is the crawler behind the Seedcite free audit. It runs when someone enters a URL into the audit, or when a customer adds a site to their account.
What it fetches
- Your robots.txt file, first.
- The page at the submitted URL and a small number of linked pages on the same site.
- Your sitemap, if listed in robots.txt.
- Structured data and basic page facts such as titles, headings and status codes.
It does not log in, submit forms or fetch pages that robots.txt disallows. It crawls slowly and stops if your server returns errors.
User agent
SeedciteAuditBot/0.1 (+https://seedcite.com/bot.html)
How to block it
Add this to your robots.txt:
User-agent: SeedciteAuditBot
Disallow: /It checks robots.txt on every run and honors the change.
Contact
Questions, complaints or unusual traffic: hello@seedcite.com. Include your domain and we will respond.