User-agent: * Content-Signal: ai-train=no, search=yes, ai-input=no Allow: / Disallow: /api/ Disallow: /dashboard Disallow: /crew/ Disallow: /approvals Disallow: /audit Disallow: /memory Disallow: /agents Disallow: /usage Disallow: /billing Disallow: /portfolio Disallow: /settings Disallow: /onboarding Disallow: /work Disallow: /login Disallow: /pending-approval Disallow: /company Disallow: /users Disallow: /user-approvals Disallow: /docs Disallow: /automations Disallow: /initiatives Disallow: /shared/ User-agent: GPTBot Content-Signal: ai-train=no, search=yes, ai-input=no Allow: / Allow: /control Allow: /code-studio Allow: /cost Allow: /pricing Allow: /privacy Allow: /terms Allow: /dpa Allow: /subprocessors Allow: /trust Allow: /llms.txt User-agent: ChatGPT-User Content-Signal: ai-train=no, search=yes, ai-input=no Allow: / Allow: /control Allow: /code-studio Allow: /cost Allow: /pricing Allow: /privacy Allow: /terms Allow: /dpa Allow: /subprocessors Allow: /trust Allow: /llms.txt User-agent: Google-Extended Content-Signal: ai-train=no, search=yes, ai-input=no Allow: / Allow: /control Allow: /code-studio Allow: /cost Allow: /pricing Allow: /privacy Allow: /terms Allow: /dpa Allow: /subprocessors Allow: /trust Allow: /llms.txt User-agent: GoogleOther Content-Signal: ai-train=no, search=yes, ai-input=no Allow: / Allow: /control Allow: /code-studio Allow: /cost Allow: /pricing Allow: /privacy Allow: /terms Allow: /dpa Allow: /subprocessors Allow: /trust Allow: /llms.txt User-agent: PerplexityBot Content-Signal: ai-train=no, search=yes, ai-input=no Allow: / Allow: /control Allow: /code-studio Allow: /cost Allow: /pricing Allow: /privacy Allow: /terms Allow: /dpa Allow: /subprocessors Allow: /trust Allow: /llms.txt User-agent: ClaudeBot Content-Signal: ai-train=no, search=yes, ai-input=no Allow: / Allow: /control Allow: /code-studio Allow: /cost Allow: /pricing Allow: /privacy Allow: /terms Allow: /dpa Allow: /subprocessors Allow: /trust Allow: /llms.txt User-agent: anthropic-ai Content-Signal: ai-train=no, search=yes, ai-input=no Allow: / Allow: /control Allow: /code-studio Allow: /cost Allow: /pricing Allow: /privacy Allow: /terms Allow: /dpa Allow: /subprocessors Allow: /trust Allow: /llms.txt User-agent: Applebot-Extended Content-Signal: ai-train=no, search=yes, ai-input=no Allow: / Allow: /control Allow: /code-studio Allow: /cost Allow: /pricing Allow: /privacy Allow: /terms Allow: /dpa Allow: /subprocessors Allow: /trust Allow: /llms.txt User-agent: cohere-ai Content-Signal: ai-train=no, search=yes, ai-input=no Allow: / Allow: /control Allow: /code-studio Allow: /cost Allow: /pricing Allow: /privacy Allow: /terms Allow: /dpa Allow: /subprocessors Allow: /trust Allow: /llms.txt User-agent: Meta-ExternalAgent Content-Signal: ai-train=no, search=yes, ai-input=no Allow: / Allow: /control Allow: /code-studio Allow: /cost Allow: /pricing Allow: /privacy Allow: /terms Allow: /dpa Allow: /subprocessors Allow: /trust Allow: /llms.txt User-agent: Meta-ExternalFetcher Content-Signal: ai-train=no, search=yes, ai-input=no Allow: / Allow: /control Allow: /code-studio Allow: /cost Allow: /pricing Allow: /privacy Allow: /terms Allow: /dpa Allow: /subprocessors Allow: /trust Allow: /llms.txt User-agent: Bytespider Content-Signal: ai-train=no, search=yes, ai-input=no Allow: / Allow: /control Allow: /code-studio Allow: /cost Allow: /pricing Allow: /privacy Allow: /terms Allow: /dpa Allow: /subprocessors Allow: /trust Allow: /llms.txt User-agent: YouBot Content-Signal: ai-train=no, search=yes, ai-input=no Allow: / Allow: /control Allow: /code-studio Allow: /cost Allow: /pricing Allow: /privacy Allow: /terms Allow: /dpa Allow: /subprocessors Allow: /trust Allow: /llms.txt User-agent: Amazonbot Content-Signal: ai-train=no, search=yes, ai-input=no Allow: / Allow: /control Allow: /code-studio Allow: /cost Allow: /pricing Allow: /privacy Allow: /terms Allow: /dpa Allow: /subprocessors Allow: /trust Allow: /llms.txt User-agent: OAI-SearchBot Content-Signal: ai-train=no, search=yes, ai-input=no Allow: / Allow: /control Allow: /code-studio Allow: /cost Allow: /pricing Allow: /privacy Allow: /terms Allow: /dpa Allow: /subprocessors Allow: /trust Allow: /llms.txt User-agent: AI2Bot Content-Signal: ai-train=no, search=yes, ai-input=no Allow: / Allow: /control Allow: /code-studio Allow: /cost Allow: /pricing Allow: /privacy Allow: /terms Allow: /dpa Allow: /subprocessors Allow: /trust Allow: /llms.txt User-agent: Diffbot Content-Signal: ai-train=no, search=yes, ai-input=no Allow: / Allow: /control Allow: /code-studio Allow: /cost Allow: /pricing Allow: /privacy Allow: /terms Allow: /dpa Allow: /subprocessors Allow: /trust Allow: /llms.txt User-agent: ImagesiftBot Content-Signal: ai-train=no, search=yes, ai-input=no Allow: / Allow: /control Allow: /code-studio Allow: /cost Allow: /pricing Allow: /privacy Allow: /terms Allow: /dpa Allow: /subprocessors Allow: /trust Allow: /llms.txt User-agent: Omgilibot Content-Signal: ai-train=no, search=yes, ai-input=no Allow: / Allow: /control Allow: /code-studio Allow: /cost Allow: /pricing Allow: /privacy Allow: /terms Allow: /dpa Allow: /subprocessors Allow: /trust Allow: /llms.txt User-agent: FacebookBot Content-Signal: ai-train=no, search=yes, ai-input=no Allow: / Allow: /control Allow: /code-studio Allow: /cost Allow: /pricing Allow: /privacy Allow: /terms Allow: /dpa Allow: /subprocessors Allow: /trust Allow: /llms.txt Sitemap: https://anyforge.ai/sitemap.xml