How many times does googlebot visit your site?

Raven · Posted: Fri Sep 24, 2004 12:41 pm

But, that is a point too. I have reverted back to the nuke default gzip handler. I had been using another one that I had gotten from someone else. That may very well have been at the root of my issues.

storebuilder · Posted: Fri Sep 24, 2004 12:44 pm

Ok - but when I track back through the thread and do the "spider search" your HTML shows up clearly.. when at the time it was done it was garbage.

So can you confirm that it is on or off?

storebuilder · Posted: Fri Sep 24, 2004 12:52 pm

Crossed on the post. But I forgot to tell you the missing ingredient:

"Our Google, who art on the Intraweb, hallowed be thine url,
Thine answers come, our search be done, in html as it is in heaven,
Give us this day our daily cached page,
and forgive us our misspellings,
as we forgive those who spam against us,
and lead us not into Goatse,
But deliver us from MSN,
for thine is the Intraweb,
and the meta-tags,
and the unique hits,
for ever and ever,
</html>"

-- BugCatcher

Raven · Posted: Fri Sep 24, 2004 1:11 pm

I will have to find my link I use that tells me if the compression is on or not. Btw, here is quite a good article on HTTP Compression

Only registered users can see links on this board!
Get registered or login to the forums!

storebuilder · Posted: Fri Sep 24, 2004 1:31 pm

Thanks for that - will have a good read.

Raven · Posted: Fri Sep 24, 2004 3:38 pm

Almost 2900 times already today. Evidently the food is quite tasty now Laughing

Edit: Over 4500 hits today!

storebuilder · Posted: Fri Sep 24, 2004 3:53 pm

And the reason is?

Raven · Posted: Fri Sep 24, 2004 3:54 pm

I lead a good life ROTFL

Guardian2003 · Posted: Sat Sep 25, 2004 4:15 am

I'm left feeling a bit inadequate now with only an average 20 google hits a day Bang Head

Muffin · Client Joined: Apr 10, 2004 Posts: 649 Location: UK

Me too rofl

I'm only ranked as 16 in google and I wanna get nearer the top.

Guardian2003 · Posted: Sat Sep 25, 2004 7:30 am

I manged to get my Alexa ranking down from over 3 milion to under 1 million in two weeks which wasnt too bad.

dean · Worker Joined: Apr 14, 2004 Posts: 193

I'm concerned about lack of googlebots at my site. Prior to an upgrade last month from nuke 6.5 to 7.3 I was using GT Nextgen 0.4a and receiving multiple visits everyday from googletap and recognized those visits by the ip: crawlerxx.googlebot.com.

The last time I saw that ip on my site was 9/12. I checked my htaccess file and see these entries:

#deny from 200.158.243.150
deny from 217.160.129.159
deny from 81.74.252.73
deny from unknown...
deny from 200.181.211.77
deny from 68.12.91.153
deny from 68.14.10.166
deny from 64.12.186.203
deny from 64.12.186.204

Now I don't think any of these are googlebots but would appreciate any feedback. What else can I do to bring google back?

EDIT: In case it matters, I forgot to add that I also moved the site from one directory to another.

Raven · Posted: Mon Sep 27, 2004 4:43 pm

Guardian2003 wrote:

I manged to get my Alexa ranking down from over 3 milion to under 1 million in two weeks which wasnt too bad.

I just checked mine and it's 54,999. I'll have to watch it and see how it improves.

Guardian2003 · Posted: Mon Sep 27, 2004 11:35 pm

Raven, do a search for 'Alexa Booster' - but mind the server resources if you decide to give it a go Wink

blarneystone · Client Joined: Sep 18, 2004 Posts: 62

I noticed I snagged googlebot twice today from the 66.249.64.* range.. what's the best way to UNBLOCK those?

Raven · Posted: Tue Sep 28, 2004 9:04 am

Through the NukeSentinel Admin panel. Btw, do you run Google Ads? Was it the Media User Agent or the normal Googlebot?

blarneystone · Client Joined: Sep 18, 2004 Posts: 62

I don't run Google Ads. The agent was Googlebot/2.1 (+http://www.google.com/bot.html)

Raven · Posted: Tue Sep 28, 2004 11:10 am

Make sure your robots.txt file is set upcorrectly. That bot seems to obey the styandard nuke robots.txt file but MediaPartners does not. That's why I asked.

SmackDaddy · Posted: Tue Sep 28, 2004 2:00 pm

Raven wrote:

Make sure your robots.txt file is set upcorrectly. That bot seems to obey the styandard nuke robots.txt file but MediaPartners does not. That's why I asked.

How does one do this when Google is getting blocked for revisiting a page that changed because it was causing people to be banned (for having parenthesis)??!? I had to unblock a googlebot again today for coming back to visit this danged cached page....... ARRRRGGGGGGGGGG!!!!!

beetraham · Posted: Tue Sep 28, 2004 2:46 pm

Dear Raven, All,

As I passed through this Topic, I suddenly realized (1) particular feature that was identified as a unique one differing from all the other contemporarly opened *PHP-Nuke* sites' browser windows at that particular instant of time;

Most of the PHP-Nuke sites being "Google crawled/indexed" would seem to actively utilized the *Dynamic Title Addon" with *$sitename* preceding the actual *Dynamic Titles Add-On*, mainly to boost up differentiation between Forum postings, thus enhancing cyber identity coverage - however, this was not my *exact* point at this occasion.

So, what is my point? Smile

The point is that I am currently incapable of identifying decoded *$sitename* variable information in any of the Forum Topics' *PAGE TITLES* seen at this site.

So, I was wondering, whether there could be any chance to consider the missing decoded *$sitename* variable information in the *PAGE TITLE* section as a partially potential source of causing the negative impact on getting currently crawled/ranked by the Google?

This is just a "hunch", but as I intuitively understand it, it is generally considered valuable to associate each of the AVAILABLE (potentionally crawled/indexed) pages *PAGE TITLE* sections with decoded *$sitename* variable information, such as "RAVENPHPSCRIPTS* in this particular case.

All in all, in my humble opinion, I am a little bit confused that this information is not currently being set visible for browsers (spiders, crawlers as well?).

I can only figure out (2) possible source of origin for the observed feature; *misconfigured* Dynamic Title Addon or missing *General Options* information.

Please let me know your conceptions due to referred potential source of annoyance.

Thanks,

BR,

-beetraham

TheosEleos · Posted: Tue Sep 28, 2004 3:15 pm

The google bots know what site they are on, right?

It would stand to reason that it would index all information read to whatever site it is on.

If it is on this site and reading a forum post where the title is 'windows xp sp2" it should index that title and post text to whatever site it is on.

I hope I understand this right, too.

beetraham · Posted: Tue Sep 28, 2004 3:29 pm

TheosEleos wrote:

The google bots know what site they are on, right?

It would stand to reason that it would index all information read to whatever site it is on.

If it is on this site and reading a forum post where the title is 'windows xp sp2" it should index that title and post text to whatever site it is on.

I hope I understand this right, too.

Thank you, TheosEleos.

Excellent clarification due to subject - I fully agree with you. Thanks again.

And, yes - I should strive to learn to read the whole thread and nothing but the whole thread prior to posting any goofies. Wink

BR,

-beetraham

storebuilder · Posted: Wed Sep 29, 2004 1:44 am

That's correct.

The way that the dynamic titles add on was originally written means that all of your site titles are prefixed by $sitetitle and then the module name.

Purely from a search engine ranking point of view we only want the page title to display in the browser title bar, this is the bit that gets indexed and shows up in a search on google or msn.

dean · Worker Joined: Apr 14, 2004 Posts: 193

So does anyone have a new improved dynamic title add on that doesnt generate the sitename in the title available for download?

TheosEleos · Posted: Wed Sep 29, 2004 8:35 am

This is what I use. Got it from storebuilder.

Code:

<?php
/********************************************************************/
/* SN Dynamic Titles Addon */
/* =========================== */
/* Copyright (c) 2003 by Greg Schoper */
/* http://nuke.schoper.net */
/* */
/* Based on code from PHP-Nuke */
/* Copyright (c) 2002 by Francisco Burzi */
/* http://phpnuke.org */
/* */
/* This program is free software. You can redistribute it and/or */
/* modify it under the terms of the GNU General Public License as */
/* published by the Free Software Foundation; either version 2 of */
/* the License. */
/********************************************************************/
/* Credit to unknown author of original forums code in */
/* includes/dynamic_titles.php. */
/********************************************************************/

if (eregi("dynamic_titles.php",$_SERVER['PHP_SELF'])) {
Header("Location: index.html");
die();
}

// Item Delimeter
$item_delim = "";

$newpagetitle = "";
global $name;
include ("config.php");
include("db/db.php");

// Forums
if($name=="Forums"){
global $p,$t,$forum,$f;
$newpagetitle = "pHenyls House Forums";
if($p) {
$sql = "SELECT post_subject, post_id FROM ".$prefix."_bbposts_text WHERE post_id='$p'";
$result = $db->sql_query($sql);
$row = $db->sql_fetchrow($result);
$title = $row[post_subject];
$post = $row[post_id];

$newpagetitle = "$title";
}
if($t) {
$sql = "SELECT topic_title, forum_id FROM ".$prefix."_bbtopics WHERE topic_id='$t'";
$result = $db->sql_query($sql);
$row = $db->sql_fetchrow($result);
$title = $row[topic_title];
$forum = $row[forum_id];

$sql = "SELECT forum_name FROM ".$prefix."_bbforums WHERE forum_id='$forum'";
$result = $db->sql_query($sql);
$row = $db->sql_fetchrow($result);
$forum = $row[forum_name];
$newpagetitle = "$title";
}
elseif($f) {
$sql = "SELECT forum_name FROM ".$prefix."_bbforums WHERE forum_id='$f'";
$result = $db->sql_query($sql);
$row = $db->sql_fetchrow($result);
$forum = $row[forum_name];
$newpagetitle = "$forum";
}
}

// News
if($name=="News"){
global $file,$sid,$new_topic;
$newpagetitle= "$item_delim $name";
if ($new_topic!=""){
$sql = "SELECT topictext FROM ".$prefix."_topics WHERE topicid='$new_topic'";
$result = $db->sql_query($sql);
$row = $db->sql_fetchrow($result);
$top = $row[topictext];
$newpagetitle= "$top";
}
if ($file=="article"){
$sql = "SELECT title, topic FROM ".$prefix."_stories WHERE sid='$sid'";
$result = $db->sql_query($sql);
$row = $db->sql_fetchrow($result);
$art = $row[title];
$top = $row[topic];
$sql = "SELECT topictext FROM ".$prefix."_topics WHERE topicid='$top'";
$result = $db->sql_query($sql);
$row = $db->sql_fetchrow($result);
$top = $row[topictext];
$newpagetitle= "$art";
}
}

// Topics
if($name=="Topics"){
$newpagetitle = "$item_delim "._ACTIVETOPICS."";
}

// Downloads
if($name=="Downloads"){
global $d_op,$cid,$lid;
$newpagetitle = "$item_delim $name";
if($d_op=="viewdownload") {
$sql = "SELECT title, parentid FROM ".$prefix."_downloads_categories WHERE cid='$cid'";
$result = $db->sql_query($sql);
$row = $db->sql_fetchrow($result);
$cat = $row[title];
$parent = $row[parentid];
if($parent=="0"){
$newpagetitle = "$name $cat";
}
else{
$sql = "SELECT title FROM ".$prefix."_downloads_categories WHERE cid='$parent'";
$result = $db->sql_query($sql);
$row = $db->sql_fetchrow($result);
$parent = $row[title];
$newpagetitle = "$name $parent $cat";
}
}
if($d_op=="viewdownloaddetails" || $d_op=="getit") {
$sql = "SELECT title FROM ".$prefix."_downloads_downloads WHERE lid='$lid'";
$result = $db->sql_query($sql);
$row = $db->sql_fetchrow($result);
$dl = $row[title];
$newpagetitle = "$name $dl";
}
}

// Web Links
if($name=="Web_Links"){
global $l_op,$cid,$lid;
$name=ereg_replace("_", " ", "$name");
$newpagetitle = " $name"; if($l_op=="viewlink") {
$sql = "SELECT title, parentid FROM ".$prefix."_links_categories WHERE cid='$cid'";
$result = $db->sql_query($sql);
$row = $db->sql_fetchrow($result);
$cat = $row[title];
$parent = $row[parentid];
if($parent=="0"){
$newpagetitle = "$name $cat";
}
else{
$sql = "SELECT title FROM ".$prefix."_links_categories WHERE cid='$parent'";
$result = $db->sql_query($sql);
$row = $db->sql_fetchrow($result);
$parent = $row[title];
$newpagetitle = "$name $parent $cat";
}
}
}

// Content
if($name=="Content"){
global $pa,$cid,$pid;
$newpagetitle = "$item_delim $name";
if($pa=="list_pages_categories") {
$sql = "SELECT title FROM ".$prefix."_pages_categories WHERE cid='$cid'";
$result = $db->sql_query($sql);
$row = $db->sql_fetchrow($result);
$cat = $row[title];
$newpagetitle = "$name $cat";
}
if($pa=="showpage") {
$sql = "SELECT title, cid FROM ".$prefix."_pages WHERE pid='$pid'";
$result = $db->sql_query($sql);
$row = $db->sql_fetchrow($result);
$page = $row[title];
$cid = $row[cid];
$sql = "SELECT title FROM ".$prefix."_pages_categories WHERE cid='$cid'";
$result = $db->sql_query($sql);
$row = $db->sql_fetchrow($result);
$cat = $row[title];
$newpagetitle = "$page";
}
}

// Reviews
if($name=="Reviews"){
global $rop,$id;
$newpagetitle = "$name";
if($rop=="showcontent") {
$sql = "SELECT title FROM ".$prefix."_reviews WHERE id='$id'";
$result = $db->sql_query($sql);
$row = $db->sql_fetchrow($result);
$rev = $row[title];
$newpagetitle = "$name $rev";
}
}

// Stories Archive
if($name=="Stories_Archive"){
global $sa,$year,$month_l;
$name=ereg_replace("_", " ", "$name");
$newpagetitle = "$name";
if($sa=="show_month") {
$newpagetitle = "$name $month_l, $year";
}
}

// Sections
if($name=="Sections"){
global $op,$secid,$artid;
$newpagetitle = "$item_delim $name";
if($op=="listarticles") {
$sql = "SELECT secname FROM ".$prefix."_sections WHERE secid='$secid'";
$result = $db->sql_query($sql);
$row = $db->sql_fetchrow($result);
$sec = $row[secname];
$newpagetitle = "$name $sec";
}
if($op=="viewarticle") {
$sql = "SELECT title, secid FROM ".$prefix."_seccont WHERE artid='$artid'";
$result = $db->sql_query($sql);
$row = $db->sql_fetchrow($result);
$art = $row[title];
$cid = $row[secid];
$sql = "SELECT secname FROM ".$prefix."_sections WHERE secid='$cid'";
$result = $db->sql_query($sql);
$row = $db->sql_fetchrow($result);
$sec = $row[secname];
$newpagetitle = "$art";
}
}

// Catchall for anything we don't have custom coding for
if($newpagetitle==""){
$name=ereg_replace("_", " ", "$name");
$newpagetitle="$name";
}

// Admin Pages
if(substr($_SERVER['REQUEST_URI'], 0, 10)=="/admin.php"){
$newpagetitle="Administration for My Site";
}

// If we're on the main page let's use our site slogan
if($_SERVER['REQUEST_URI']=="/index.php" || $_SERVER['REQUEST_URI']=="/"){
$newpagetitle="$slogan";
}

// We're Done! Place the Title on the page
echo "<title>$newpagetitle</title>\n";

?>