You know, I really like the fact that people come and visit this little corner of the web because they found us on a search engine. But does Yahoo Slurp seem a little overzealous to you?
Let's take this month for an example. Slurp has gone through 36megs of bandwidth and only sent me 12 visitors. Admittedly 36 megs isn't much, but Google has sent me over 600 visitors and only crawled through 13 megs with less than half the total hits. Heck, even Microsoft Live has sent almost 150 visitors.
I guess the question is why does Slurp need so much more bandwidth and total connections than other search engines.
Ryan