User-agent: * Disallow: /my/ User-Agent: Yandex Allow: / Disallow: /my/ Host: xn--80aqfme0a.xn--90ais User-agent: msnbot Crawl-delay: 10 User-agent: MJ12bot Disallow: / User-agent: AhrefsBot Disallow: / User-agent: SemrushBot Disallow: / User-agent: SemrushBot-SA Disallow: / User-agent: DotBot Disallow: / User-agent: SBarkrowler Disallow: / User-agent: BLEXBot Disallow: /