User-agent: Mediapartners-Google Disallow: User-agent: rogerbot User-agent: dotbot User-agent: AhrefsBot User-agent: MJ12bot User-agent: linkdexbot User-agent: Sosospider User-agent: proximic User-agent: Baiduspider User-agent: Baiduspider-video User-agent: Baiduspider-image User-agent: NaverBot User-agent: Yeti User-agent: coccoc User-agent: BLEXBot User-agent: sogou spider User-agent: SemrushBot User-agent: Cliqzbot Disallow: / User-agent: * Disallow: /search Disallow: /favorites Disallow: /sync/utc Disallow: /sync/cities Disallow: /go Disallow: /compare?city