What this tool checks
- Whether robots.txt exists and is readable
- A "block everything" rule (Disallow: /)
- Sitemap lines inside robots.txt
- Common sitemap locations
- Number of addresses listed in the sitemap
How to use it
- Enter your website address.
- Press the check button.
- Fix anything marked red, then submit your sitemap in Google Search Console.
Why it matters for hotels, resorts and tour operators
Two small files control how search engines see your site. Robots.txt tells them where they may go, and the sitemap lists the pages you want indexed. A single wrong line can hide your whole website from Google, which often happens after a website redesign when a "discourage search engines" setting is left on.
Check both after every major change, and make sure your sitemap is submitted in Google Search Console.
Need help acting on the results? See our SEO and website services or book a free consultation.
Frequently asked questions
What is a robots.txt file?
A small text file at the root of your site that tells search engines which areas they may crawl.
What does "Disallow: /" mean?
It blocks all crawlers from the whole site. It is only correct for private or test sites.
Where should my sitemap be?
Commonly at /sitemap.xml or /sitemap_index.xml, and listed in robots.txt with a Sitemap line.
How do I submit a sitemap to Google?
Add your site in Google Search Console, open Sitemaps, and enter the sitemap address.
Can you do technical SEO for my site?
Yes. We handle crawl setup, sitemaps and indexing as part of our SEO service.