Use the robots.txt file with caution and create a healthy website