# This file sets out restrictions that most spiders and automatic # web-indexers voluntarily abide by. For more information, check out: # http://info.webcrawler.com/mak/projects/robots/norobots.html # All other robots have some restrictions on them, though User-agent: * # Stay away from these: Disallow: