# See https://www.robotstxt.org/robotstxt.html for documentation on how to use the robots.txt file # # AI crawlers are intentionally ALLOWED on this marketplace (SEO/AEO/GEO N1). # The following user agents inherit the wildcard rules below and are never # blocked by platform defaults (spec-locked in spec/requests/seo/robots_txt_spec.rb): # - GPTBot # - OAI-SearchBot # - ChatGPT-User # - ClaudeBot # - Claude-User # - Claude-SearchBot # - PerplexityBot # - Perplexity-User # - Google-Extended # - GoogleOther # - Meta-ExternalAgent # - Meta-ExternalFetcher # - GrokBot # - CCBot User-agent: * Disallow: /checkout Disallow: /cart Disallow: /orders Disallow: /user Disallow: /account Disallow: /api Disallow: /password Disallow: /api_tokens Disallow: /cart_link Disallow: /account_link Disallow: /search Disallow: /admin Disallow: /login Disallow: /logout Disallow: /vendors Disallow: /*?integrationtype=* Disallow: /*&integrationtype=* Disallow: /*?g2plan=* Disallow: /*&g2plan=* Disallow: /*?star_rating=* Disallow: /*&star_rating=* Sitemap: https://partnerhub.g2.com/sitemap.xml.gz # AI-readable index: https://partnerhub.g2.com/llms.txt