Originally, website owners submitted the deal with of the site, or URL to the various search engines like google and yahoo, which would send out an internet crawler to crawl that webpage, extract inbound links to other internet pages from it, and return facts discovered about the web page to https://www.youtube.com/watch?v=HmdZ6Ymv04I