- Can Googlebot,etc artifically boost your traffic?
- Posted by Kkiely on June 8th, 2004
If you have a 500 page web site, could your traffic be artifically boosted if
Googlebot and MSNbot visit your site and index all the pages? 4 bots and that
would be 2,000 views. That is assuming a bot visit registers as a page view, is
that true or not?
- Posted by Allis on June 8th, 2004
"Kkiely" <kkiely@aol.comnojunk> wrote in message
news:20040607233834.18493.00000668@mb-m07.aol.com...
Don't think GBot, or any Search engine bots can even count views.
Think for a second. How does the bot know the view count when it's not
indexing the pages??
Maybe it leaves a counting worm behind that checks visitors.
- Posted by Viper on June 8th, 2004
Kkiely wrote:
Not sure... But one thing I know is watch how you link your sites pages
together. GBot and the MSN Bot got caught in my PPC Search engine... I
finally had to ban the IPs from my site and then the next day use robots.txt
to block the from indexing anything but the main page.
- Posted by John Bokma on June 8th, 2004
Kkiely wrote:
crawler13.googlebot.com - - [01/Jun/2004:04:04:32 -0700] "GET
/robots.txt HTTP/1.0" 200 70 "-" "Googlebot/2.1
(+http://www.googlebot.com/bot.html)"
crawler13.googlebot.com - - [01/Jun/2004:04:04:32 -0700] "GET
/spreadsheets.html HTTP/1.0" 200 1123 "-" "Googlebot/2.1
(+http://www.googlebot.com/bot.html)"
This can be counted as 2 hits. A visit is often unique IP/address within
a given timeframe, so this can be counted as 1 visit.
It all depends on how your software works.
There are more bots out there, some don't honor the robots.txt. Some are
very hard to distinguish from real visitors, if at all.
If "someone" visits the links on your site in order (top down on a
page), it's often a bot, most often looking for email address(es).
--
John MexIT: http://johnbokma.com/mexit/
personal page: http://johnbokma.com/
Experienced Perl programmer available: http://castleamber.com/
Happy Customers: http://castleamber.com/testimonials.html
- Posted by Augustus on June 8th, 2004
"Kkiely" <kkiely@aol.comnojunk> wrote in message
news:20040607233834.18493.00000668@mb-m07.aol.com...
If bots indexing your site have enough of an impact on your websites to be a
boost to traffic... I would say you have bigger things to worry about
- Posted by Matt Probert on June 8th, 2004
On 08 Jun 2004 03:38:34 GMT kkiely@aol.comnojunk (Kkiely) broke off
from drinking a cup of tea at AOL http://www.aol.com to write:
They register in your logs. They expend your transfer allowance. They
don't buy products, but they do provide subsequent advertising.
In short. Yes.
Matt
--
Free searchable encyclopaedia content for your web site:
http://www.probertencyclopaedia.com/xsearch.htm
- Posted by Els on June 8th, 2004
Kkiely wrote:
They are all in the access_log, but I use Awstats to have a
nice overview, and somehow Google and Yahoo aren't
registered as page views (they go in a seperate
'bot-department'), but the MSN-bot is registered like a
regular visitor.
--
Els
http://locusmeus.com/
Sonhos vem. Sonhos vão. O resto é imperfeito.
- Renato Russo -
- Posted by Charles Sweeney on June 8th, 2004
"Augustus" <Imperial.Palace@Rome.com> wrote in message
news:2ikvt2FntocbU1@uni-berlin.de...
)
--
Charles Sweeney
www.CharlesSweeney.com
- Posted by TechnoHippie on June 8th, 2004
Kkiely wrote:
Definately. The stats app I use excludes any IPs I add to the list.
MSNbot is the worst at skewing your pageviews. Somewhere, in the FAQs I
think, is a list of bots and their associated IPs. Don't stop them in
you .htaccess file or you'll fall out of the search engines. But there
are a few that are a waste of bandwidth that you can safely deny.
Do some research
--
Judy
http://www.technohippie.com/html
http://kaos.evergreen.edu/KAOS16.ram
- Posted by TechnoHippie on June 8th, 2004
Viper wrote:
They get stuck in my ODP ... I've denied that directory and my traffic
is looking more normal.
--
Judy
http://www.technohippie.com/html
http://kaos.evergreen.edu/KAOS16.ram
