robots.txt report

himalayas.app

https://himalayas.app

B

88/100

Complexity 70/100

How scoring works
User Agents
1
Rules
26
Sitemaps
22
Pass
0
File Size
2.1 KB
Cached result · Expires in 23 hours 16 minutes

No problems found

8 checks passed

1 crawlers named · 1 unrecognised

Not checked

Who this file lets in

  • Every other crawler all 1 allowed

Path Access Checker

Detailed Analysis

Pass

Search engines can reach the site

All 6 checked search engines are allowed at the site root.

Pass

AI answer engines can reach the site

All 4 checked AI answer engines are allowed at the site root.

Pass

User-triggered AI fetches can reach the site

All 3 checked user-triggered AI fetches are allowed at the site root.

Pass

Social link previews can reach the site

All 5 checked social link previews are allowed at the site root.

Pass

AI training crawlers can reach the site

All 6 checked AI training crawlers are allowed at the site root.

Pass

No indexing directives on the requested page

The page sends no robots meta tag and no X-Robots-Tag header.

Not checked

12 declared sitemaps were not checked

These sitemaps were not seen: each was blocked for our bot, left out by a limit, or did not answer in time. Each line says which.

Consequence. Nothing is known about whether they work. They are not counted against the file.

  • https://himalayas.app/sitemap-candidates-locations.xml.gzL39Not fetched: only the first few sitemaps are fetched, within a time limit and the site's Crawl-delay
  • https://himalayas.app/sitemap-companies-salaries.xml.gzL40Not fetched: only the first few sitemaps are fetched, within a time limit and the site's Crawl-delay
  • https://himalayas.app/sitemap-companies-technologies.xml.gzL41Not fetched: only the first few sitemaps are fetched, within a time limit and the site's Crawl-delay
  • https://himalayas.app/sitemap-companies-benefits.xml.gzL42Not fetched: only the first few sitemaps are fetched, within a time limit and the site's Crawl-delay
  • https://himalayas.app/sitemap-talent-location-keywords.xml.gzL43Not fetched: only the first few sitemaps are fetched, within a time limit and the site's Crawl-delay
  • https://himalayas.app/sitemap-talent-people-directory.xml.gzL44Not fetched: only the first few sitemaps are fetched, within a time limit and the site's Crawl-delay
  • https://himalayas.app/sitemap-job-location-keywords.xml.gzL45Not fetched: only the first few sitemaps are fetched, within a time limit and the site's Crawl-delay
  • https://himalayas.app/sitemap-external-salaries.xml.gzL46Not fetched: only the first few sitemaps are fetched, within a time limit and the site's Crawl-delay
  • https://himalayas.app/advice/sitemap-posts.xml.gzL47Not fetched: only the first few sitemaps are fetched, within a time limit and the site's Crawl-delay
  • https://himalayas.app/advice/sitemap-authors.xml.gzL48Not fetched: only the first few sitemaps are fetched, within a time limit and the site's Crawl-delay
  • https://himalayas.app/advice/sitemap-tags.xml.gzL49Not fetched: only the first few sitemaps are fetched, within a time limit and the site's Crawl-delay
  • https://himalayas.app/advice/sitemap-audiences.xml.gzL50Not fetched: only the first few sitemaps are fetched, within a time limit and the site's Crawl-delay
Pass

No syntax problems

Every line parses as a directive crawlers understand.

Pass

File size is 2.1 KB

Comfortably within the 500 KB that crawlers will read.