- Googlebot...
- Posted by Will on March 8th, 2006
Hi,
Is it usual for the googlebot to spider orphan folders which have
no references to them anywhere?
For example, last night I put up a proposed new index page for a
client to look at, in a newly made entirely unreferenced folder on a
website that google spiders fairly regularly. I recently did a similar
thing for another proposed page.
In both cases, the googlebot spidered them on its next visit. How
does it find such folders? Is it normal?
Thanks.
--
Regards,
Will.
- Posted by William Tasso on March 8th, 2006
Fleeing from the madness of the jungle
Will <not.me@no.way> stumbled into news:alt.www.webmaster
and said:
How do you do?
If that were true (no references) then it's unlikely, but ...
... do you have the google tool-bar loaded? or perhaps a version of
Opera that still displays context sensitive ads? or maybe your client
does?
perhaps you have a dynamic site-map script?
Check your logs - you'll see some access you don't recognise right there
between your browsing the pages and the goog-bot slurping it up.
--
William Tasso
whither a trophy?
- Posted by dingbat@codesmiths.com on March 8th, 2006
Will wrote:
Yes, this is fairly common. It's caused by previously visiting those
pages (either you or your customer) with the Google toolbar active.
They're definitely getting evil....
- Posted by Will on March 8th, 2006
In article <1141827562.341088.9130@i40g2000cwc.googlegroups.c om>,
dingbat@codesmiths.com says...
Hi, thanks to both you and William, I do have some parts of the
google toolbar enabled, so I guess that's it.
Cheers,
--
Regards,
Will.


