Est. 2003
Home Help Login Register
News: Welcome to ZboX Webhosting.
10 Megs

10 MB Disk
1 GB Transfer
$10.00 per year 		25 Megs

25 MB Disk
2 GB Transfer
$25.00 per year 		50 Megs

50 MB Disk
3 GB Transfer
$50.00 per year 		75 Megs

75 MB Disk
4 GB Transfer
$75.00 per year 		500 Megs

500 MB Disk
10 GB Trans
$100.00 yr.

+  ZboX Webhosting Est. 2003. Now in our Fourth year!
|-+  Help!
| |-+  Problems and/or Questions
| | |-+  robot.txt files?		 0 Members and 1 Guest are viewing this topic. « previous next »
Pages: [1] Go Down Print
Author Topic: robot.txt files?  (Read 478 times)
colliope
ZboXian
**
Offline Offline

Posts: 33
robot.txt files?
« on: February 20, 2006, 04:26:53 PM »
Are these allowed at Zbox and if so, it would go here:  /public_html/ robot.txt (what i normally refer to as my root directory)  right??

Col
Logged
ZboX
Founder
Administrator
Posting Maniac
*****
Online Online

Posts: 1516


What 'ya got there??
Re: robot.txt files?
« Reply #1 on: February 20, 2006, 07:50:54 PM »
Quote from: colliope on February 20, 2006, 04:26:53 PM
Are these allowed at Zbox and if so, it would go here:  /public_html/ robot.txt (what i normally refer to as my root directory)  right??

Col

Hi Col,
Yes Ma'am the robots.txt file will go into your root (public_html) directory. Make sure you name it robots.txt not robot.txt

~;-)

Bert
Logged
Homepage / Community: http://zboxhosting.com

Contact: sales@zboxhosting.com
"When all is said and done, there's nothing left to say or do!"
colliope
ZboXian
**
Offline Offline

Posts: 33
Re: robot.txt files?
« Reply #2 on: February 21, 2006, 05:02:18 AM »
Thanks!

Col
Logged
spiral_one
Mega ZboXian
***
Offline Offline

Posts: 76
Re: robot.txt files?
« Reply #3 on: February 25, 2008, 10:01:33 PM »
Along these lines, here's a few links to help you understand what a robots.txt file does and why it's helpful:

http://www.webmasters-central.com/wp/se/robotstxt.shtml

http://www.javascriptkit.com/howto/robots.shtml

http://www.wehostem.com/clients/knowledgebase.php?action=displayarticle&catid=1&id=1

Once you get a feel in these, here's some code that you can also put into your ROOT .htaccess file that will help guard against some of the rogue/troublemaker search bots to help keep your bandwidth from being chewed up. Make sure you:

delete the 1st line:
RewriteEngine on because that's already in there

delete the line:
RewriteCond %{HTTP_USER_AGENT} ^Wget [OR]

Ok, here's the txt file with the BadBots .htaccess codes:

http://linuxreviews.org/webdesign/htaccess/StopBadBots.htaccess.txt

Good Luck
« Last Edit: February 25, 2008, 10:25:45 PM by spiral_one » Logged

My Website @Zbox
Ink and Paper Spiralbound

Code:
I am here to keep myself from going crazy just thinking about it
Pages: [1] Go Up Print 
« previous next »
Jump to:  


Login with username, password and session length

ZboX Webhosting Est. 2003. Now in our Fourth year! | Powered by SMF 1.0.10.
© 2005, Simple Machines LLC. All Rights Reserved.
Page created in 0.059 seconds with 21 queries.