User-agent: * Allow: / # The sign-in, sign-up, password-reset and error routes are deliberately absent # from the rules below. Each one carries , # and a crawler has to fetch a page to read that directive. A Disallow stops the # fetch, so a URL already in the index would sit there with the noindex never # read. Crawlability is the precondition for deindexing. # # What stays blocked is what has no reader value at any time: the authenticated # dashboard, the API and Cloudflare's own endpoints. Disallow: /dashboard/ Disallow: /api/ Disallow: /cdn-cgi/ Sitemap: https://guardr.io/sitemap-index.xml