Ravens PHP Scripts: Forums
 

 

View next topic
View previous topic
Post new topic   Reply to topic    Ravens PHP Scripts And Web Hosting Forum Index -> General/Other Stuff
Author Message
dpeloquin
New Member
New Member


Joined: Mar 01, 2006
Posts: 7

PostPosted: Sat Jul 01, 2006 2:51 pm Reply with quote

I'm somewhat of a newbie, so I beg your patience....

Is it possible to lock the site down (e.g., everything is restricted to Registered Users), yet still allowing spidering of the site? To ask from a different perspective, is there a way of either a) registering specific bots so that they login, or b) knowing a request is coming from a spiders an treating them as an authenticated user in the code?
 
View user's profile Send private message
hitwalker
Sells PC To Pay For Divorce


Joined:
Posts: 5661

PostPosted: Sat Jul 01, 2006 3:05 pm Reply with quote

no...you cant..
its not sure how a bot crawls a mod that is only for members.
but its likely that it will have problems figuring out what you have for content.
but generaly speaking ,if you lock your site then the best thing a bot has is your index and if relevant your metatags...
but some bot reads them,and others dont.
 
View user's profile Send private message
montego
Site Admin


Joined: Aug 29, 2004
Posts: 9456
Location: Arizona

PostPosted: Wed Jul 05, 2006 8:50 pm Reply with quote

There might be a way to do it with some careful recoding of the is_user() function, but it may not even be limited to just that function.

To be honest, not sure its worth it. If its indexed, you would be sending people to your site only to be met with "Access is restricted" messages all over the place. In my opinion, that would just tick people off to no end.... it would for me!

Think about it. When you are looking for information, you really have no idea how "good the find" is until you go look at the content. If you can't get what you want quickly, would you really go through the registration process not really knowing for sure if you are going to get a "good hit"?

Not to mention, have you given consideration to the cached content? Google and other search engines cache these pages and anyone can get to the cached content anytime they wish without even going to your site.

Just good for thought.

_________________
Only registered users can see links on this board! Get registered or login!
Only registered users can see links on this board! Get registered or login! 
View user's profile Send private message Visit poster's website
dpeloquin
PostPosted: Thu Jul 06, 2006 3:38 am Reply with quote

I appreciate the reply. This is not something that I would choose to do, but I have been asked to investigate it.

Our leadership seems to think that by resticting the content they can get more people to register. My thoughts are that we're more likely to drive people away and limit search engine exposure than anything else, but I need to do the due diligence in case I have to go on a forced march.

Can you give me an idea of what constructs I'm looking for in is_user(), and an overview of how they would need to change, please?
 
Display posts from previous:       
Post new topic   Reply to topic    Ravens PHP Scripts And Web Hosting Forum Index -> General/Other Stuff

View next topic
View previous topic
You cannot post new topics in this forum
You cannot reply to topics in this forum
You cannot edit your posts in this forum
You cannot delete your posts in this forum
You cannot vote in polls in this forum
You can attach files in this forum
You can download files in this forum


Powered by phpBB © 2001-2007 phpBB Group
All times are GMT - 6 Hours
 
Forums ©