PDA

View Full Version : how can create the Robot.txt file



eagleeye dental
09-02-2014, 06:06 AM
how can create the Robot.txt file

Fli
09-05-2014, 07:52 AM
You can create Robots.txt file through Robots.txt generation online.
google: robots.txt generator online
or just create new file in your hosting account root folder (where is index.php) and name it robots.txt

example robots content:

User-agent: *
Disallow: /admin/

it means that all robots (all user agents) are allowed to index all your website except one folder (yoursite.com/admin/)

josephinek
07-22-2015, 11:44 AM
Go through the link webtools.live2support.com/se_robots.php to create robot.txt .