Affordable SEO by SEOClerks
+ Post New Thread
Results 1 to 6 of 6

Thread: What is robots.txt?

  1. #1
    Member himanshu's Avatar
    Join Date
    May 2019
    Posts
    41
    Post Thanks / Like

    What is robots.txt?



    What is robots.txt?

  2. #2
    Junior Member Mihirthakur's Avatar
    Join Date
    Jun 2019
    Posts
    16
    Post Thanks / Like


    Is this useful / helpfull? Yes | No
    Robots.txt is used to instruct bots How to crawl the web pages

  3. #3
    Member sohailkhan's Avatar
    Join Date
    May 2019
    Posts
    40
    Post Thanks / Like


    Is this useful / helpfull? Yes | No
    Robot.txt is mainly used to instruct the web bots how to crawl the web pages

  4. #4
    Junior Member ajay_11's Avatar
    Join Date
    Jun 2019
    Posts
    23
    Post Thanks / Like


    Is this useful / helpfull? Yes | No
    Robots.txt is a text file webmasters use to instruct google bots to crawl the website

  5. #5
    Junior Member nikhil's Avatar
    Join Date
    Jun 2019
    Posts
    7
    Post Thanks / Like


    Is this useful / helpfull? Yes | No
    robots.txt allow or disallow the google bots that which page to be crawled or not.

  6. #6
    Banned suhel's Avatar
    Join Date
    Jun 2019
    Posts
    18
    Post Thanks / Like


    Is this useful / helpfull? Yes | No
    Robots.txt is used to instruct bots How to crawl the website

+ Post New Thread

Posting Permissions

  • You may not post new threads
  • You may not post replies
  • You may not post attachments
  • You may not edit your posts
  •  
 Protected by : ZB BLOCK  &  StopForumSpam