Search engine hitting site from multiple IP's

Posted: Fri Feb 24, 2006 7:04 pm

My site www.clanfga.com is currently getting hit by w w w.gigablast.com many times per day from different IP's. They claim they offer "real-time indexing" Some days there are 20 or 30 instances with different IP's seconds apart. When I go to their webpage and search for my site --- nada. I don't know if this is some attempt to hack me or what. I tried banning the range of IP's the were using and that worked for a few days, but now they are back using more IP's similar to, but outside, the range I banned. I don't want to ban legitimate search engines, but none of the well known search engines even comes close to hitting the site like this. Here is a small sample of the tracked hits from gigablast.

Quote:

66.154.103.37 www.gigablast.com 2006-02-24 05:50:08 2
66.154.102.11 www.gigablast.com 2006-02-24 04:33:05 1
66.154.103.38 www.gigablast.com 2006-02-24 03:22:52 1
66.154.103.41 www.gigablast.com 2006-02-24 01:08:56 2
66.154.102.142 www.gigablast.com 2006-02-23 23:00:03 3
66.154.103.46 www.gigablast.com 2006-02-23 21:59:52 3

I never submitted my site to them. I never heard of them until they started showing up on the IP tracker and on the "visitors" list in the Users block.

Any suggestions? or advice?

Also, one of my users is giving me multiple hits with different IP's seconds apart. Here is an example of his hits:

Quote:

205.188.116.198 cache-dtc-ad04.proxy.aol.com 2006-02-21 17:56:41 2
205.188.116.199 cache-dtc-ad05.proxy.aol.com 2006-02-21 17:56:17 2
205.188.116.196 cache-dtc-ad02.proxy.aol.com 2006-02-21 17:56:06 4
205.188.116.7 cache-dtc-aa03.proxy.aol.com 2006-02-21 17:55:56 9
205.188.116.131 cache-dtc-ac02.proxy.aol.com 2006-02-21 17:55:41 7
205.188.117.10 cache-dtc-ae06.proxy.aol.com 2006-02-21 17:53:48 3
205.188.117.7 cache-dtc-ae03.proxy.aol.com 2006-02-21 17:53:16 2
205.188.117.6 cache-dtc-ae02.proxy.aol.com 2006-02-21 15:42:01 3
205.188.116.14 cache-dtc-aa10.proxy.aol.com 2006-02-21 15:40:28 2
205.188.116.195 cache-dtc-ad01.proxy.aol.com 2006-02-21 15:39:48

Should I be worried about either of these?

Sells PC To Pay For Divorce Joined: Posts: 5661

Well are you blocking the whole world perhaps?

I just looked at your site and you still have phpnuke's standard keyword in your page,useless or not....better change those in your meta.php (includes folder)

Further,....after checking your site i get the following results:

info for [ Only registered users can see links on this board! Get registered or login! ]
Website http://www.clanfga.com
Page Rank 0 / 10
Indexed Pages 1
BackLinks 0

Search Engine Indexed Links
Google - Not Available
Yahoo! - 5 from [ Only registered users can see links on this board! Get registered or login! ]
AlltheWeb - 1
AltaVista - 5
Total - 11

That means in the whole world wide web your known on 11 pages....
And your blocking gigablast ?

Posted: Fri Feb 24, 2006 9:26 pm

Don't really know what I am doing. That is why I come here for advice.

Posted: Fri Feb 24, 2006 9:32 pm

i know....lol
but like i said....
first take care of your keywords in meta.phh

second undo the gigablast banning,....
if you have sentinel installed it will take care of any unwanted visitors,human or bots.
and be happy when your site gets crawled.

Posted: Fri Feb 24, 2006 11:55 pm

It looks to be a valid search engine, I've seen it indexing my site. Not seen it actually deliver users yet

If your being hit really hard, try using robots.txt [ Only registered users can see links on this board! Get registered or login! ]

Posted: Sat Feb 25, 2006 12:17 pm

Ok, I unbanned gigablast and updated my meta.php file. Don't really know anything about robots.txt yet, but I will be trying to learn what to do there. Thanks for the help.

I don't understand why I am getting so many hits from gigablast since I did not submit to them. I only get a few hits a week from google and I did submit to them. Must have to do with the "real time" indexing the claim. Don't know.

Posted: Sat Feb 25, 2006 2:00 pm

well bots often come unrequested...lol
but there's a lot of info on the forums here how to put your robots file together....