Privacy Policy

Last updated: March 28, 2026

What CrawlGraderBot collects from websites

CrawlGraderBot collects only publicly visible, technical metadata from websites it visits. This data is identical to what any visitor or standard networking tool (curl, dig, openssl) can observe. We collect:

• HTTP response headers (server software, security headers, caching directives)
• TLS certificate metadata (issuer, type, TLS version — not private keys)
• DNS records (nameservers, MX provider category, SPF/DMARC presence)
• HTML meta tags (generator, canonical URL, hreflang, Schema.org organization type)
• Cookie names for technology detection (we never read or store cookie values)
• robots.txt and sitemap.xml structure and statistics
• Connection performance metrics (TTFB, page size, compression type)

What we never collect

CrawlGraderBot is designed with strict data boundaries:

• Personal information of any kind (names, email addresses, phone numbers, physical addresses)
• Employee data, headcounts, or salary information
• Cookie values, session tokens, or authentication data
• Content behind login or authentication
• User-generated content, comments, or forum posts
• Page content, article text, images, or media files
• IP addresses of scanned servers (we store domain names only)

No public reports

CrawlGrader does not publish public-facing reports, pages, or profiles for any domain. Collected data is only accessible through the CrawlGrader API to authenticated subscribers.

crawlgrader.com visitors

When you visit crawlgrader.com:

• We do not use cookies
• We do not run analytics or tracking scripts
• We do not collect any visitor data
• Server logs may temporarily record IP addresses for security purposes and are purged within 7 days

Data removal

Website owners can exclude their domain from CrawlGrader at any time:

• Add CrawlGraderBot to your robots.txt with Disallow: / — data purged within 24 hours
• Email privacy@crawlgrader.com for immediate removal

Data processing and jurisdiction

CrawlGrader processes only non-personal, technical metadata derived from publicly accessible servers. As no personal data is collected, processed, or stored, the Digital Personal Data Protection Act, 2023 (India) and GDPR (EU) provisions regarding personal data do not apply to our crawling activities.

Contact

Privacy questions: privacy@crawlgrader.com