User-agent: * Disallow: /php/fetch/ User-agent: AhrefsBot Disallow: / User-agent: Amazonbot Disallow: / User-agent: Applebot Disallow: / User-agent: Barkrowler Disallow: / User-agent: CCBot Disallow: / User-agent: ChatGPT-User Disallow: / User-agent: ClaudeBot Disallow: / User-agent: dotbot Disallow: / User-agent: GPTBot Disallow: / User-agent: MJ12Bot Disallow: / User-agent: MojeekBot Disallow: / User-agent: OAI-SearchBot Disallow: / User-agent: PerplexityBot Disallow: / User-agent: PetalBot Disallow: / User-agent: Qwantbot Disallow: / User-agent: SemrushBot Disallow: / User-agent: Sogou Disallow: / User-agent: YandexBot Disallow: /