+ Post New Thread
Results 1 to 7 of 7

Thread: What is robots.txt?

  1. 06-18-2019, 06:39 AM #1
    himanshu
    himanshu is offline
    Member himanshu's Avatar
    Join Date
    May 2019
    Posts
    41

    What is robots.txt?

    What is robots.txt?
    Buy Rdp Online
  2. 06-18-2019, 07:33 AM #2
    Mihirthakur
    Mihirthakur is offline
    Junior Member Mihirthakur's Avatar
    Join Date
    Jun 2019
    Posts
    16

    Is this useful / helpfull? Yes | No
    Robots.txt is used to instruct bots How to crawl the web pages
    Cheap dedicated servers in Usa || Cheap Reseller Hosting
  3. 06-18-2019, 08:46 AM #3
    sohailkhan
    sohailkhan is offline
    Member sohailkhan's Avatar
    Join Date
    May 2019
    Posts
    39

    Is this useful / helpfull? Yes | No
    Robot.txt is mainly used to instruct the web bots how to crawl the web pages
    Buy Server India
  4. 06-19-2019, 09:38 AM #4
    ajay_11
    ajay_11 is offline
    Junior Member ajay_11's Avatar
    Join Date
    Jun 2019
    Posts
    23

    Is this useful / helpfull? Yes | No
    Robots.txt is a text file webmasters use to instruct google bots to crawl the website
    Cheap Indian proxy server
  5. 06-20-2019, 06:40 AM #5
    suhel
    suhel is offline
    Junior Member suhel's Avatar
    Join Date
    Jun 2019
    Posts
    18

    Is this useful / helpfull? Yes | No
    Robots.txt is used to instruct bots How to crawl the website
    Buy proxies
  6. 10-03-2019, 11:31 AM #6
    Raju
    Raju is offline
    Senior Member Raju's Avatar
    Join Date
    Feb 2019
    Location
    Nagpur
    Posts
    162

    Is this useful / helpfull? Yes | No
    Robots.txt is a text file webmasters create to instruct web robots how to crawl pages on their website.
    Get Best Collection of Rakhi Gifts 2020
+ Post New Thread
« Previous Thread | Next Thread »

Similar Threads

  1. Which is better Robots.txt or Meta Robots Tag?
    By swatijain2233 in forum General Webmaster Discussion
    Replies: 7
    Last Post: 09-19-2019, 12:42 PM
  2. What is robots.txt
    By Sonamkumari in forum SEO - Search Engine Optimisation
    Replies: 1
    Last Post: 03-24-2018, 08:50 AM
  3. Which is better Robots.txt or Meta Robots Tag?
    By Sonamkumari in forum SEO - Search Engine Optimisation
    Replies: 2
    Last Post: 08-11-2017, 07:28 AM
  4. What is the use of robots.txt?
    By artijain1900 in forum SEO - Search Engine Optimisation
    Replies: 1
    Last Post: 09-23-2016, 01:42 PM
  5. What is robots.txt?
    By eagleeye dental in forum SEO - Search Engine Optimisation
    Replies: 3
    Last Post: 09-16-2014, 08:17 PM

Bookmarks

Posting Permissions

  • You may not post new threads
  • You may not post replies
  • You may not post attachments
  • You may not edit your posts
  •  

Forum Rules

 Protected by : ZB BLOCK  &  StopForumSpam