Robots txt file uses

Collapse
X
 
  • Time
  • Show
Clear All
new posts
  • mike40
    Senior Member
    • Dec 2009
    • 398

    Robots txt file uses

    Robots txt file is very usefull to prevent any bot to index your web site, infact each web site should have because i do not think that many crawlers check and index your web site with having robots.txt
Working...