SeoDanielPetrica Crawler

Information for webmasters about our automated crawler.

What is SeoDanielPetrica?

SeoDanielPetrica is an automated SEO auditing tool. It crawls websites to analyze on-page SEO factors including meta tags, headings, structured data, image alt text, page speed, and more. The results help website owners identify and fix SEO issues.

User-Agent

Our crawler identifies itself with the following user-agent strings:

  • SeoDanielPetrica/1.0 — Page and sitemap crawling
  • SeoDanielPetrica-DomainHealth/1.0 — Domain health checks (robots.txt, SSL, sitemap validation)

What We Crawl

The crawler visits pages registered for monitoring by our users. It only crawls domains that users have explicitly added to their SEO by Daniel dashboard. We crawl:

  • Pages discovered through sitemaps (XML sitemaps and sitemap indexes)
  • Individual pages added by users for on-demand analysis
  • Infrastructure files: robots.txt, sitemap.xml, security.txt, llms.txt

Rate Limiting

We respect per-domain rate limits. Each domain has a configurable pages-per-hour limit and batch size set by the user. Our crawler enforces crawl-delay directives from robots.txt (capped at 10 seconds) and never exceeds reasonable request rates.

Robots.txt Compliance

We respect robots.txt. The crawler checks robots.txt before every request and honors:

  • Disallow directives — we skip disallowed paths
  • Crawl-delay directives — we wait between requests
  • We respect both User-agent: * and User-agent: SeoDanielPetrica blocks

How to Block SeoDanielPetrica

To prevent SeoDanielPetrica from crawling your site, add the following to your robots.txt:

User-agent: SeoDanielPetrica
Disallow: /

You can also block specific paths by using partial Disallow directives.

Contact

If you have questions or concerns about our crawler, contact Daniel Petrica at [email protected].

Cloudflare Verified Bot

SeoDanielPetrica is registered as a Cloudflare Verified Bot. You can find us in the Cloudflare Radar verified bots directory.

Our classification: Search Engine Optimization / SEO behavior, Direct operation.