This report is outdated. It was fetched on , and a newer version from is available.

View the latest version

robots.txt report

whop.com

https://whop.com/

C

69/100

Complexity 45/100

How scoring works
User Agents
1
Rules
3
Sitemaps
4
Warning
1
File Size
289 B

1 thing to look at

1 warning · 8 pass

1 crawlers named · 1 unrecognised

Who this file lets in

  • Every other crawler all 1 allowed

Path Access Checker

Detailed Analysis

Warning

1 declared sitemap does not return XML

The URL responds, but the body does not open as an XML urlset or sitemapindex.

Consequence. A sitemap that is not valid XML is discarded. A common cause is the URL resolving to an HTML error page or a redirect to the home page.

If that is not intended. Confirm the URL serves XML beginning with <urlset> or <sitemapindex>, and that it is served as application/xml or text/xml.

  • https://whop.com/rss/discover/newest_arrivals.rssL9HTTP 200, but the body does not open as XML (Content-Type: application/xml; charset=utf-8)
Pass

Search engines can reach the site

All 6 checked search engines are allowed at the site root.

Pass

AI answer engines can reach the site

All 4 checked AI answer engines are allowed at the site root.

Pass

User-triggered AI fetches can reach the site

All 3 checked user-triggered AI fetches are allowed at the site root.

Pass

Social link previews can reach the site

All 5 checked social link previews are allowed at the site root.

Pass

AI training crawlers can reach the site

All 6 checked AI training crawlers are allowed at the site root.

Pass

Page indexing directives are consistent

1 meta tag and 0 X-Robots-Tag headers, with no contradictions.

  • <meta name="robots" content="index, follow">Page HTML
Pass

No syntax problems

Every line parses as a directive crawlers understand.

Pass

File size is 289 bytes

Comfortably within the 500 KB that crawlers will read.