User-agent: * Disallow: /admin/ Disallow: /api/ Disallow: /secret/ Disallow: /info/ Disallow: /search/ Disallow: /users/cart/ Disallow: /users/order/ Disallow: /users/order_check/ Disallow: /users/profile/ Disallow: /users/pdf/ Disallow: /users/email/ Disallow: /users/code/ Disallow: /users/logout/ Disallow: /users/webhook-payment/ Disallow: /users/api-* Disallow: /users/cookie-consent/ Disallow: /users/report/ Disallow: /*?v2= Disallow: /*?id= Disallow: /*/component/ Allow: / # 2026-05-18: Explicit allow for AI assistants and training crawlers # Same restrictions as User-agent: * User-agent: GPTBot User-agent: ChatGPT-User User-agent: OAI-SearchBot User-agent: ClaudeBot User-agent: anthropic-ai User-agent: Claude-Web User-agent: PerplexityBot User-agent: Perplexity-User User-agent: Google-Extended User-agent: Applebot-Extended User-agent: cohere-ai User-agent: cohere-training-data-crawler User-agent: CCBot User-agent: Bytespider User-agent: Meta-ExternalAgent User-agent: Meta-ExternalFetcher User-agent: Amazonbot User-agent: FacebookBot User-agent: DuckAssistBot User-agent: YouBot User-agent: PetalBot Disallow: /admin/ Disallow: /api/ Disallow: /secret/ Disallow: /info/ Disallow: /search/ Disallow: /users/ Disallow: /*?id= Disallow: /*/component/ Allow: / Sitemap: https://diagnostdata.ru/sitemap.xml