Robots.txt Configuration
Configure how search engines crawl your website
Admin Access Required
Only administrators can modify robots.txt settings.
Current Robots.txt Output
User-agent: * Allow: / # Sitemap location Sitemap: https://kenneezllc.com/Sitemap # Disallow admin pages Disallow: /Admin* Disallow: /ClientDashboard # Allow specific pages Allow: /Services Allow: /Portfolio Allow: /Blog Allow: /Contact # Crawl delay (optional) Crawl-delay: 10
Quick Reference
User-agent: * - Applies to all crawlers
Allow: /page - Allow crawling of specific pages
Disallow: /admin - Block specific pages
Sitemap: - Location of your sitemap
Crawl-delay: - Seconds between requests