# GEO审计哨兵 robots.txt (RFC 9309) # 仅放行公开页面;其余路径需要登录,不对爬虫开放。 User-agent: * User-agent: Googlebot User-agent: Bingbot User-agent: Baiduspider User-agent: Applebot User-agent: GPTBot User-agent: OAI-SearchBot User-agent: ChatGPT-User User-agent: ClaudeBot User-agent: Claude-SearchBot User-agent: Claude-User User-agent: anthropic-ai User-agent: PerplexityBot User-agent: Perplexity-User User-agent: Google-Extended User-agent: Applebot-Extended User-agent: Bytespider User-agent: CCBot User-agent: Meta-ExternalAgent User-agent: Amazonbot Allow: /$ Allow: /privacy Allow: /crawlers Allow: /about Allow: /help Allow: /guide Allow: /guide/checklist Allow: /guide/myths Allow: /guide/vetting Allow: /guide/glossary Allow: /geo-audit Allow: /llms.txt Allow: /llms-full.txt Allow: /sitemap.xml Disallow: / Sitemap: https://geoshaobing.com/sitemap.xml