Googlebot Hammering My Website!

[BioALIEN]

Googlebot has been absolutely ripping through my bandwidth. This has been on going for many months now, but each month the damage has gotten worse and worse.

To demonstrate the problem, I have decided to show you all my server stats for one of my websites. I have no choice but to ban googlebot from my site and follow this action with a letter to google!

We're only a day and a half into this month and Google's stupid robots have already consumed over 1gig of bandwidth!

Any help would be appreciated!

[Clayton]

that is plain ridiculous

contact Google and ask them how u can rectify the situation

in the old days such amounts would have cost a fortune

Good Luck

C

[BioALIEN]

In response to my letter to Google's support team, their webmaster/sitemap team just released their crawl rate feature. This helps site owners to slow the rate of crawl on their site. I will test it out and see if this resolves the problem.