User-agent: * Allow: / # Specific crawling instructions User-agent: Googlebot Allow: / Crawl-delay: 1 User-agent: Bingbot Allow: / Crawl-delay: 1 # Sitemap location Sitemap: https://cognidemia.com/sitemap.xml # Disallow admin areas if you have any # Disallow: /admin/ # Disallow: /private/