User-agent: * Allow: / Sitemap: https://www.green-n-safe.com/Common/SitemapXml User-agent: Amazonbot # Amazon's user agent Disallow: /do-not-crawl/ # disallow this directory User-agent: dotbot Disallow: / User-agent: AhrefsBot Disallow: /