Affordable SEO by SEOClerks
+ Post New Thread
Results 1 to 7 of 7

Thread: What is robots.txt?

  1. #1
    Member himanshu's Avatar
    Join Date
    May 2019
    Posts
    41

    What is robots.txt?



    What is robots.txt?

  2. #2
    Junior Member Mihirthakur's Avatar
    Join Date
    Jun 2019
    Posts
    16


    Is this useful / helpfull? Yes | No
    Robots.txt is used to instruct bots How to crawl the web pages

  3. #3
    Member sohailkhan's Avatar
    Join Date
    May 2019
    Posts
    40


    Is this useful / helpfull? Yes | No
    Robot.txt is mainly used to instruct the web bots how to crawl the web pages

  4. #4
    Junior Member ajay_11's Avatar
    Join Date
    Jun 2019
    Posts
    23


    Is this useful / helpfull? Yes | No
    Robots.txt is a text file webmasters use to instruct google bots to crawl the website

  5. #5
    Junior Member suhel's Avatar
    Join Date
    Jun 2019
    Posts
    18


    Is this useful / helpfull? Yes | No
    Robots.txt is used to instruct bots How to crawl the website

  6. #6
    Banned Raju's Avatar
    Join Date
    Feb 2019
    Location
    Nagpur
    Posts
    123


    Is this useful / helpfull? Yes | No
    Robots.txt is a text file webmasters create to instruct web robots how to crawl pages on their website.

+ Post New Thread

Similar Threads

  1. Which is better Robots.txt or Meta Robots Tag?
    By swatijain2233 in forum General Webmaster Discussion
    Replies: 7
    Last Post: 09-19-2019, 12:42 PM
  2. What is robots.txt
    By Sonamkumari in forum SEO - Search Engine Optimisation
    Replies: 1
    Last Post: 03-24-2018, 08:50 AM
  3. Which is better Robots.txt or Meta Robots Tag?
    By Sonamkumari in forum SEO - Search Engine Optimisation
    Replies: 3
    Last Post: 08-11-2017, 07:28 AM
  4. What is the use of robots.txt?
    By artijain1900 in forum SEO - Search Engine Optimisation
    Replies: 1
    Last Post: 09-23-2016, 01:42 PM
  5. What is robots.txt?
    By eagleeye dental in forum SEO - Search Engine Optimisation
    Replies: 3
    Last Post: 09-16-2014, 08:17 PM

Posting Permissions

  • You may not post new threads
  • You may not post replies
  • You may not post attachments
  • You may not edit your posts
  •  
 Protected by : ZB BLOCK  &  StopForumSpam