# /robots.txt file for http://www.traveltasmania.com.au/ # # Allow everything except /stats which may contain links to # non-existant pages as the site organization changes. # Include the trailing slash, else we will exclude visits to # all top-level directories beginning with "stats". # # Also disallow /cgi-bin as this area is not searchable anyway # User-agent: * Disallow: /about/stats/ Disallow: /cgi-bin/