# Normal search-engine indexing is welcome (Google, Bing, etc.). Bulk harvesting
# and reuse of the dataset are addressed by our Terms of Use (/terms.html) and by
# Cloudflare rate-limiting — NOT by robots.txt (scrapers ignore it, and blocking
# /places.json would only stop Googlebot from rendering the map and hurt SEO).

User-agent: *
Allow: /
Disallow: /place-drop.html      # internal add-place tool; already noindex

Sitemap: https://shlangi.com/sitemap.xml