User-agent: * Disallow: /admin Disallow: /go/ Disallow: /find/results # Training crawlers we do not allow. GPTBot and ClaudeBot are welcome. # Cloudflare blocks these two as well; this asks the ones that listen. User-agent: CCBot Disallow: / User-agent: Bytespider Disallow: / Sitemap: https://abovespot.com.au/sitemap.xml