CHECK GLOSSARY · ROBOTS-003

No robots.txt

In plain words: Crawlers assume everything is allowed, but a robots.txt lets you point them to your sitemap.

How to fix it

Add a simple robots.txt with a Sitemap line.

Official sources

• Google: robots.txt

Related checks

• ANALYTICS-001: No analytics detected
• SITEMAP-003: No XML sitemap
• REDIR-001: Redirect chain
• HTTP-001: Broken or missing page

Check my site free → All checks