What is a robots.txt file?

Collapse
X
 
  • Time
  • Show
Clear All
new posts
  • Patelsharp
    Senior Member
    • Feb 2014
    • 111

    What is a robots.txt file?

    What is a robots.txt file.
    Last edited by Patelsharp; 04-21-2014, 12:58 PM.
  • Garima Sharma
    Senior Member
    • Feb 2014
    • 171

    #2
    I don't have much knowledge about that.

    Comment

    • deepika
      Member
      • Feb 2014
      • 44

      #3
      Robots Exclusion.

      The Robot Exclusion Standard, also known as the Robots Exclusion Protocol or robots.txt protocol. It is a de-facto standard, and is not owned by any standard body. It is a convention to advise cooperating web crawlers and web robots about accessing all or part of a website which is otherwise publicly viewable. Robots are mostly used by search engines. The “/robots.txt” file is a text file, with one or more records
      I Love Myself

      Comment

      Working...
      😀
      😂
      🥰
      😘
      🤢
      😎
      😞
      😡
      👍
      👎