Social media marketing Influence: Preferred tendencies on social websites can spill above into search engines like google, impacting the search volume of related search phrases. txt file is then parsed and may instruct the robotic as to which internet pages aren't to get crawled. To be a internet search engine https://www.youtube.com/watch?v=cZppEXx1zPU