Comments on: Attack of the bots http://www.s-anand.net/blog/attack-of-the-bots/ Technology, business and fun Mon, 08 Mar 2010 12:25:16 +0000 http://wordpress.org/?v=2.9.2 hourly 1 By: S Anand http://www.s-anand.net/blog/attack-of-the-bots/comment-page-1/#comment-106 S Anand Mon, 01 Sep 2008 06:11:58 +0000 http://localhost/blog/attack-of-the-bots/#comment-106 1. I think Yahoo's crawler is aggressive in any case. My site doesn't seem to be an exception: there are a lot of threads discussing this problem. <br>2. Google's webmaster tools tells you how many URLs have been indexed from your sitemap. 1. I think Yahoo’s crawler is aggressive in any case. My site doesn’t seem to be an exception: there are a lot of threads discussing this problem.
2. Google’s webmaster tools tells you how many URLs have been indexed from your sitemap.

]]> By: Dhar http://www.s-anand.net/blog/attack-of-the-bots/comment-page-1/#comment-105 Dhar Mon, 01 Sep 2008 03:09:33 +0000 http://localhost/blog/attack-of-the-bots/#comment-105 Hmmm, curious as to: <br> <br>1. Why the bots should crawl your site every 5 seconds or so? <br>2. How you can find out how much of your site has been indexed by Google. <br> <br>Cheers, <br>D. Hmmm, curious as to:

1. Why the bots should crawl your site every 5 seconds or so?
2. How you can find out how much of your site has been indexed by Google.

Cheers,
D.

]]>