# Allow all crawlers User-agent: * Allow: / # Sitemap location Sitemap: https://tharasystems.com/sitemap.xml # Disallow admin and private routes Disallow: /admin/ Disallow: /private/ Disallow: /api/ Disallow: /netlify/ # Crawl-delay for rate limiting Crawl-delay: 10