What is a robots.txt file?

[Patelsharp]

What is a robots.txt file.

[Garima Sharma]

I don't have much knowledge about that.

[deepika]

Robots Exclusion.

The Robot Exclusion Standard, also known as the Robots Exclusion Protocol or robots.txt protocol. It is a de-facto standard, and is not owned by any standard body. It is a convention to advise cooperating web crawlers and web robots about accessing all or part of a website which is otherwise publicly viewable. Robots are mostly used by search engines. The “/robots.txt” file is a text file, with one or more records