Ravens PHP Scripts: Forums
 

 

View next topic
View previous topic
Post new topic   Reply to topic    Ravens PHP Scripts And Web Hosting Forum Index -> General/Other Stuff
Author Message
mrix
Client


Joined: Dec 04, 2004
Posts: 757

PostPosted: Mon May 16, 2005 2:09 am Reply with quote

Hello all, I have always used the default Robots.txt file and never make any changes to it, I was wondering if I should be making changes to it to help in search engines etc or does it as default do its job ok?
Cheers
mrix
 
View user's profile Send private message Visit poster's website
Susann
Moderator


Joined: Dec 19, 2004
Posts: 3191
Location: Germany:Moderator German NukeSentinel Support

PostPosted: Mon May 16, 2005 4:50 am Reply with quote

You can check your robots.txt here:
Only registered users can see links on this board! Get registered or login!


It´s a reall good robots.txt syntax checker.


Last edited by Susann on Mon May 16, 2005 4:59 am; edited 1 time in total 
View user's profile Send private message
mrix
PostPosted: Mon May 16, 2005 4:56 am Reply with quote

Hi I tried that test out and had one error which said
Disallow: admin.php
We advise you to start a file/directory name with a leading slash char (Example: /private.html).

dont understand it to be honest?
thanks for your help
mrix
p.s
my robots.txt looks like this
User-agent: Mediapartners-Google*
Disallow:

User-agent: *
Disallow: admin.php
Disallow: /admin/
Disallow: /images/
Disallow: /includes/
Disallow: /themes/
Disallow: /blocks/
Disallow: /modules/
Disallow: /language/

actually this is the standard robots.txt file for 7.6 and 7.7? is it wrong?
 
Susann
PostPosted: Mon May 16, 2005 5:04 am Reply with quote

Try this for admin:

User-agent: *
Disallow: /admin.php
Disallow: /admin/
 
mrix
PostPosted: Mon May 16, 2005 5:56 am Reply with quote

Hello again, I have tried that test again with your changes and all is pasted fine, I cant understand though why would the makers of phpnuke would have as default the robots.txt the other way etc?
thanks again
mrix
 
Susann
PostPosted: Mon May 16, 2005 6:46 am Reply with quote

I don´t know. But i checked my Nuke 6.5 severall times with different robots.text checkers before and this one is the best of all. There are also no errors, if u use crawl-delay for some bots.
 
Dauthus
Worker
Worker


Joined: Oct 07, 2003
Posts: 211

PostPosted: Tue May 17, 2005 4:59 pm Reply with quote

For some good info on robots.txt, look at this one:
Only registered users can see links on this board! Get registered or login!

Also, here is a really good set of tutorials:
Only registered users can see links on this board! Get registered or login!

_________________
Only registered users can see links on this board! Get registered or login!
Vivere disce, cogita mori 
View user's profile Send private message Visit poster's website
Display posts from previous:       
Post new topic   Reply to topic    Ravens PHP Scripts And Web Hosting Forum Index -> General/Other Stuff

View next topic
View previous topic
You cannot post new topics in this forum
You cannot reply to topics in this forum
You cannot edit your posts in this forum
You cannot delete your posts in this forum
You cannot vote in polls in this forum
You can attach files in this forum
You can download files in this forum


Powered by phpBB © 2001-2007 phpBB Group
All times are GMT - 6 Hours
 
Forums ©