Ravens PHP Scripts: Forums
 

 

View next topic
View previous topic
This forum is locked: you cannot post, reply to, or edit topics.   This topic is locked: you cannot edit posts or make replies.    Ravens PHP Scripts And Web Hosting Forum Index -> NukeSentinel™ v2.5.x
Author Message
mrix
Client


Joined: Dec 04, 2004
Posts: 757

PostPosted: Thu Feb 22, 2007 4:43 pm Reply with quote

Hello all, I cant understand why search engines like msn get blocked from my site? I am running the latest sentinal. How do allow msn to search my site? I would have thought sentinal would allow it by default? I am wondering now how many more search engines maybe being blocked etc?
thanks for any help all
mrix
 
View user's profile Send private message Visit poster's website
jakec
Site Admin


Joined: Feb 06, 2006
Posts: 3048
Location: United Kingdom

PostPosted: Thu Feb 22, 2007 4:46 pm Reply with quote

What part of the site are they trying to access?

What reason is sentinel giving for blocking the SE?
 
View user's profile Send private message
mrix
PostPosted: Thu Feb 22, 2007 5:27 pm Reply with quote

This one block

User Agent: msnbot/1.0 (+http://search.msn.com/msnbot.htm)
Query String:
/modules.php?name=Downloads&d_op=viewdownload&cid=1(\"derby=titleA
Get String:
/modules.php?name=Downloads&d_op=viewdownload&cid=1(\"derby=titleA
Post String: /modules.php
Forwarded For: none
Client IP: none
 
montego
Site Admin


Joined: Aug 29, 2004
Posts: 9449
Location: Arizona

PostPosted: Thu Feb 22, 2007 6:27 pm Reply with quote

mrix, no, what was the block reason?

I have had a few like this recently from msnbot. Its almost like they have changed something and are possibly ignoring the crawl-delay statement that I have in my robots.txt. This used to work fine. However, it is not ALL of the msnbots. So, maybe they just have bug causing one or two to go "astray".

Mine were tripped with the flood blocker.

_________________
Only registered users can see links on this board! Get registered or login!
Only registered users can see links on this board! Get registered or login! 
View user's profile Send private message Visit poster's website
montego
PostPosted: Thu Feb 22, 2007 6:29 pm Reply with quote

Oh, crap, I forgot to mention that you can keep them from getting blocked by adding them to your Protected Ranges. Hey, new IP ranges are assigned all the time. So, these are most likely new ones that you have not seen before. You have to keep adding these as you find them.
 
mrix
PostPosted: Thu Feb 22, 2007 6:30 pm Reply with quote

Hello yea sorry this is the top section of that
Blocked IP: 65.55.212.235
User ID: Visitor (1)
Reason: Abuse-Script

I also at time get some yahoo bots blocked also

cheers
mrix
 
mrix
PostPosted: Thu Feb 22, 2007 6:32 pm Reply with quote

I see so whenever a search engine gets blocked I can add it to the Protected Ranges
ok that sounds good to me
thanks for the help all
mrix
 
montego
PostPosted: Thu Feb 22, 2007 6:54 pm Reply with quote

Ok, that is different. Do you by chance have parenthesis in your download title? If so, i'd get rid of them.
 
mrix
PostPosted: Thu Feb 22, 2007 6:56 pm Reply with quote

Quote:
have parenthesis in your download title?


sorry I have not idea what you mean could you explain a bit more
thanks for the help
mrix
 
montego
PostPosted: Thu Feb 22, 2007 7:00 pm Reply with quote

Well, that query string for one is looking really odd to me. Have you done anything recently to your downloads, such as install a different downloads module?

But, do you see this here: (\"derby=titleA

The backslash "\" is simply there in the email (added prior to being sent out), but I am concerned by this:

(derby

Does your download title start off with a left-parenthesis? Download title is the name that you gave it in the downloads admin.
 
Display posts from previous:       
This forum is locked: you cannot post, reply to, or edit topics.   This topic is locked: you cannot edit posts or make replies.    Ravens PHP Scripts And Web Hosting Forum Index -> NukeSentinel™ v2.5.x

View next topic
View previous topic
You cannot post new topics in this forum
You cannot reply to topics in this forum
You cannot edit your posts in this forum
You cannot delete your posts in this forum
You cannot vote in polls in this forum
You can attach files in this forum
You can download files in this forum


Powered by phpBB © 2001-2007 phpBB Group
All times are GMT - 6 Hours
 
Forums ©