# Repolog — robots.txt # https://repolog.io # # We welcome general search crawlers and AI assistants. # If you represent a crawler and something here blocks you in error, # please reach out: https://repolog.io User-agent: * Allow: / Disallow: /api/ Disallow: /dashboard/ # Allow major AI crawlers so our content is citable in ChatGPT, # Claude, Perplexity and Google AI Overviews. User-agent: GPTBot Allow: / Disallow: /api/ Disallow: /dashboard/ User-agent: OAI-SearchBot Allow: / Disallow: /api/ Disallow: /dashboard/ User-agent: ChatGPT-User Allow: / Disallow: /api/ Disallow: /dashboard/ User-agent: ClaudeBot Allow: / Disallow: /api/ Disallow: /dashboard/ User-agent: Claude-Web Allow: / Disallow: /api/ Disallow: /dashboard/ User-agent: anthropic-ai Allow: / Disallow: /api/ Disallow: /dashboard/ User-agent: PerplexityBot Allow: / Disallow: /api/ Disallow: /dashboard/ User-agent: Perplexity-User Allow: / Disallow: /api/ Disallow: /dashboard/ User-agent: Google-Extended Allow: / Disallow: /api/ Disallow: /dashboard/ User-agent: Applebot-Extended Allow: / Disallow: /api/ Disallow: /dashboard/ User-agent: CCBot Allow: / Disallow: /api/ Disallow: /dashboard/ User-agent: meta-externalagent Allow: / Disallow: /api/ Disallow: /dashboard/ Sitemap: https://repolog.io/sitemap.xml