txt file. What all you are supposed to do is You will need to variety your website URL and also the pages you want them to become excluded. You will need to decide on the two other options “Disallow all robots” and “Disallow unsafe robots.” Source page title and http://milonhcrr.blog4youth.com/8179944/rumored-buzz-on-a-to-z-seo-tools-v2