Joined: Aug 30, 2005 Posts: 3186 Location: near Albany NY
Posted:
Wed Oct 06, 2010 4:06 pm
Yes, IP by IP you will. And since they have tons of IP's it could be a slow painful process. I don't know if there is any way to get Google to delete bad links like this. If that's what it turns out to be.
Somewhere in Cpanel statistics, if you have that available there is a list of who links to you most frequently and what their links are (I think). You might take a look at that and see if it sheds any light.
Joined: Nov 06, 2005 Posts: 318 Location: Los Angeles, USA
Posted:
Wed Oct 06, 2010 4:13 pm
Guardian2003, yea would not want to do that. I have it so it just takes them to the ban page but does not actually write it to .htaccess for now.
I'm wondering if i should ban some of those top ip's. any idea how to confirm if those are legit search bots?
i know too many questions
Joined: Nov 06, 2005 Posts: 318 Location: Los Angeles, USA
Posted:
Wed Oct 06, 2010 4:48 pm
fkelly wrote:
I don't know if there is any way to get Google to delete bad links like this. If that's what it turns out to be.
That gave me an idea yes on webmaster tools I can request google to not index any particular url string. Only problem some times they will deny it. I'll give them a few to see if they take them.
Any idea how to block url string with .htaccess having a hard time finding this on google
Joined: Nov 06, 2005 Posts: 318 Location: Los Angeles, USA
Posted:
Thu Oct 07, 2010 12:21 am
Ok just an update. I checked my GPU usage report on my server and seams the problem is already fixed, all those strings seam to be gone already thanks to friends here on Raven, thank you!
Not sure which of the things I did work but I did the following
Per fkelly, suggestion I used the string blocker on NS. Enabled it and have it to go to default page and not write to htaccess per Guardian2003 info that it could block legit bots.
I removed my 404 handler.
Sommaire Menu might be taking up some resource due to guardians suggestion. Removing 404 handler fix problem. Will look in to hard coding a block later.
I edited my robot.txt file to include some of the strings on the usage report.
I requested unwanted url's removal with google in my webmaster tools google account.
If anyone is having server overages problems and big server spikes you might want to look in to some of these things
I have a new one never ending story. I see here a way to decrease usage is to avoid mod_rewrite? or 302 errors:
Only registered users can see links on this board! Get registered or login to the forums!
I'm getting hit with these 302 errors as well. Familiar to anyone? On my server it says: it appears some or all your static content is handled by mod_rewrite. to avoid find a way to handle images with out mod_rewrite.
View next topic View previous topic
You cannot post new topics in this forum You cannot reply to topics in this forum You cannot edit your posts in this forum You cannot delete your posts in this forum You cannot vote in polls in this forum