Search Engine Optimization > Webmaster World > Googlebot...
Googlebot...
Posted by Will on March 8th, 2006

Hi,

Is it usual for the googlebot to spider orphan folders which have
no references to them anywhere?

For example, last night I put up a proposed new index page for a
client to look at, in a newly made entirely unreferenced folder on a
website that google spiders fairly regularly. I recently did a similar
thing for another proposed page.

In both cases, the googlebot spidered them on its next visit. How
does it find such folders? Is it normal?

Thanks.

--
Regards,

Will.

Posted by William Tasso on March 8th, 2006

Fleeing from the madness of the jungle
Will <not.me@no.way> stumbled into news:alt.www.webmaster
and said:

How do you do?

If that were true (no references) then it's unlikely, but ...

... do you have the google tool-bar loaded? or perhaps a version of
Opera that still displays context sensitive ads? or maybe your client
does?

perhaps you have a dynamic site-map script?

Check your logs - you'll see some access you don't recognise right there
between your browsing the pages and the goog-bot slurping it up.

--
William Tasso

whither a trophy?

Posted by dingbat@codesmiths.com on March 8th, 2006

Will wrote:
Yes, this is fairly common. It's caused by previously visiting those
pages (either you or your customer) with the Google toolbar active.

They're definitely getting evil....


Posted by Will on March 8th, 2006

In article <1141827562.341088.9130@i40g2000cwc.googlegroups.c om>,
dingbat@codesmiths.com says...
Hi, thanks to both you and William, I do have some parts of the
google toolbar enabled, so I guess that's it.

Cheers,

--
Regards,

Will.

Funbolt.com - Entertainment portal, wallpapers, sexy celebs