Create robots.txt file to authenticate and cease crawler from crawling just about anything aside from your own home web site. Some websites display a similar content underneath various URLs, which is known as duplicate written content. Search engines like google pick out only one URL (the canonical URL) to point https://hellopredict.com