User-agent: * Allow: / Disallow: /api/ # Unfinished and utility pages send noindex and are omitted from the sitemap. # They stay crawlable so the noindex tag can be seen: # /ask-wfi-test, /species/beef-cattle, /search, /auth, /eggs/experiences/*, # /tools/value-of-information, /tools/welfare-impact-calculator # /tools/expert-elicitation redirects to /tools and is not in the sitemap. # Do NOT disallow the publications or PDF paths — Google Scholar must crawl them. Sitemap: https://welfarefootprint.org/sitemap.xml