You will need a Robots.txt file to create one just create a new text document on your server and add the following. ------------------------------------------------------------ # Robots.txt file created by http://www.thedomainspace.co.uk # For domain: http://www. # All robots will spider the domain User-agent: * Disallow: -------------------------------------------------------------
Just add your domain name or web address to the www.