Search Engine Guidelines Robots.txt File

Create a robots.txt file

Alright, let's get started. Create a plain text file called **robots.txt**, and make sure the filename is correct. This file must be uploaded to the root directory of your website, not a subdirectory (for example, it should be at **http://www.mysite.com/robots.txt**, not **http://www.mysite.com/stuff/robots.txt**). Only when both conditions are met—correct filename and correct path—will search engines follow the rules specified in this file. Otherwise, the robots.txt file will just be an ordinary file with no effect.