What is Robots ?

Robots are known as Crawlers, or Spiders, Robots are programs that traverse the Web automatically. Search engines such as Google, Yahoo use them to index the web content, spammers use them to scan for email addresses, and they have many other uses.