User-Agent: * Allow: / Disallow: /api/ Disallow: /admin/ Disallow: /private/ Disallow: /_next/ Disallow: /static/temp/ User-Agent: GPTBot Allow: / User-Agent: OAI-SearchBot Allow: / User-Agent: ChatGPT-User Allow: / User-Agent: PerplexityBot Allow: / User-Agent: ClaudeBot Allow: / User-Agent: Claude-User Allow: / User-Agent: Claude-Web Allow: / User-Agent: CCBot Disallow: / User-Agent: anthropic-ai Disallow: / Host: https://www.interviewpilot.app Sitemap: https://www.interviewpilot.app/sitemap.xml