User-agent: * Disallow: /admin/ Disallow: /generator/ Disallow: /docs/ Disallow: /cgi-bin/ Disallow: /cache/ Disallow: /dev/ Disallow: /dev1/ Disallow: /dev2/ Disallow: /404.php Disallow: /*print$ Disallow: /print/* Disallow: /*enlarge-map$ Disallow: /order/* Disallow: /home/update/* Disallow: /design/* #User-agent: SemrushBot #Disallow: / #User-agent: SemrushBot-SA #Disallow: / #User-agent: SemrushBot-SI #Disallow: / Disallow: /homenew/* Disallow: /homelyr/* Disallow: /hometest/* Disallow: /homedemo/* Disallow: /homesdemo/* Disallow: /homesoptimize/* Disallow: /providers/rh/* Disallow: /providers/grouprh/* Disallow: /jobs/home/* Disallow: /private/* ##Disallow: /homes/*/*/map ##Disallow: /homes/group/*/map #Disallow: /homes/*/map Disallow: /viewer/* #Disallow: /map/cat/* Disallow: /stats-app/* Disallow: /info.php Disallow: /senior-advisor/* Disallow: /about/notifications Disallow: /home/map/*