# See http://www.robotstxt.org/wc/norobots.html for documentation on how to use the robots.txt file User-agent: psbot Disallow: / User-Agent: DepSpid Disallow: / User-agent: * Disallow: /my_destination/ Disallow: /my_gusto/ Disallow: /images/ Disallow: /javascripts/ Disallow: /reviews/ Disallow: /destination/ Disallow: /travel/ Disallow: /feed/ Disallow: /gusto/suggested_books/ Disallow: /GoogleMap.html Disallow: /GoogleAjaxSearch.html Disallow: /grabber/ Disallow: /hotel/ Disallow: /car/ Disallow: /)