Pages      User Agent
----------------  ----------------------

35157      5.18%  Spider: Googlebot
26085      3.84%  Browser: Netscape 4.8
2291       0.34%  Browser: Internet Explorer 5.21 (Mac)
2180       0.32%  Browser: Firefox
2149       0.32%  Browser: Internet Explorer 3.0  (win95)
1803       0.27%  Browser: Safari (OSX)
1586       0.23%  Browser: Internet Explorer 5.0
828        0.12%  Browser: Internet Explorer 7.0 (Win)
758        0.11%  Browser: Internet Explorer 6.0 (Win)
551        0.08%  Browser: Opera
379        0.06%  Spider: MSNBot
19         0.00%  Browser: Konqueror
6          0.00%  Browser: Mozilla 1.x
3          0.00%  Browser: Internet Explorer 5.01
2          0.00%  Browser: Camino (OSX)
2          0.00%  Browser: Netscape v3.xx
1          0.00%  Browser: Internet Explorer 4.01
1          0.00%  Browser: Internet Explorer 5.5 (Win)
1          0.00%  Browser: Netscape 4.79
1          0.00%  Browser: Netscape v2.xx

260677    38.39%  mirrormanager-crawler/0.1 (+http://fedorahosted.org/mirrormanager)
121694    17.92%  Debian APT-HTTP/1.3 (0.9.7.7ubuntu4)
81721     12.04%  MirrorBrain Scanner/2.17.0 (See http://mirrorbrain.org/scanner_info)
27167      4.00%  MirrorBrain Probe (see http://mirrorbrain.org/probe_info)
21102      3.11%  Debian APT-HTTP/1.3 (0.8.16~exp12ubuntu10.10)
6960       1.03%  Mozilla/4.0 (compatible; ipMonitor 9.0)
5875       0.87%  curl/7.29.0
4613       0.68%  Debian APT-HTTP/1.3 (0.8.16~exp12ubuntu10.11)
2804       0.41%  curl/7.21.7 (x86_64-mandriva-linux-gnu) libcurl/7.21.7 OpenSSL/1.0.0d zlib/1.2.5 libidn/1.22 libssh2/1.2.9
2657       0.39%  Debian APT-HTTP/1.3 (0.9.7.5ubuntu5.1)
2621       0.39%  CentOSIPv6mirrorchecker/4.0; centos at miuku dot net
2486       0.37%  Debian APT-HTTP/1.3 (0.8.16~exp12ubuntu10.7)
2438       0.36%  Debian APT-HTTP/1.3 (0.8.16~exp5ubuntu13.7)
2086       0.31%  curl/7.21.7 (i586-mandriva-linux-gnu) libcurl/7.21.7 OpenSSL/1.0.0i zlib/1.2.5 libidn/1.22 libssh2/1.2.9
2083       0.31%  curl/7.21.7 (i586-mandriva-linux-gnu) libcurl/7.21.7 OpenSSL/1.0.0d zlib/1.2.5 libidn/1.22 libssh2/1.2.9
1969       0.29%  curl/7.21.7 (x86_64-mandriva-linux-gnu) libcurl/7.21.7 OpenSSL/1.0.0i zlib/1.2.5 libidn/1.22 libssh2/1.2.9
1447       0.21%  Wget/1.12 (linux-gnu)
1313       0.19%  curl/7.20.1 (i586-mandriva-linux-gnu) libcurl/7.20.1 OpenSSL/1.0.0a zlib/1.2.3 libidn/1.18 libssh2/1.2.5
1116       0.16%  libwww-perl/6.05
1113       0.16%  aria2/1.9.0
966        0.14%  Debian APT-HTTP/1.3 (0.8.16~exp12ubuntu10.5)
865        0.13%  TurnitinBot/2.1 (http://www.turnitin.com/robot/crawlerinfo.html)
848        0.12%  Debian APT-HTTP/1.3 (0.8.16~exp12ubuntu10)
813        0.12%  libwww-perl/6.04
776        0.11%  Wget/1.11.4
715        0.11%  libwww-perl/6.03
706        0.10%  PycURL/7.29.0
691        0.10%  Wget/1.14 (linux-gnu)
678        0.10%  PycURL/7.19.7
628        0.09%  CPAN::Mini/1.100630
625        0.09%  curl/7.19.6 (i586-mandriva-linux-gnu) libcurl/7.19.6 OpenSSL/0.9.8k zlib/1.2.3 libidn/1.15 libssh2/1.2.1
602        0.09%  curl/7.26.0
565        0.08%  curl/7.21.2 (i686-mandriva-linux-gnu) libcurl/7.21.2 OpenSSL/1.0.0a zlib/1.2.3 libidn/1.18 libssh2/1.2.5
527        0.08%  curl/7.21.7 (i586-mandriva-linux-gnu) libcurl/7.21.7 OpenSSL/1.0.0d zlib/1.2.5 libidn/1.22 libssh2/1.2.8
524        0.08%  HTTP-Tiny/0.012
423        0.06%  lftp/3.7.11
388        0.06%  Debian APT-HTTP/1.3 (0.8.13.2ubuntu4.6)
384        0.06%  Debian APT-HTTP/1.3 (1.8.17bodhi1)
297        0.04%  Wget/1.11.4 Red Hat modified
267        0.04%  curl/7.20.1 (x86_64-mandriva-linux-gnu) libcurl/7.20.1 OpenSSL/1.0.0a zlib/1.2.3 libidn/1.18 libssh2/1.2.5
256        0.04%  Debian APT-HTTP/1.3 (0.8.3ubuntu7.3)
252        0.04%  Debian APT-HTTP/1.3 (0.8.16~exp5ubuntu13)
245        0.04%  Ubuntu APT-HTTP/1.3 (0.7.25.3ubuntu9.14)
233        0.03%  DoCoMo/2.0 P900i(c100;TB;W24H11) (compatible; ichiro/mobile goo;+http://search.goo.ne.jp/option/use/sub4/sub4-1/)
205        0.03%  urlgrabber/3.9.1 yum/3.2.29
192        0.03%  zif
187        0.03%  curl/7.24.0 (i586-mandriva-linux-gnu) libcurl/7.24.0 OpenSSL/1.0.0i zlib/1.2.5 libidn/1.22 libssh2/1.2.9
181        0.03%  aria2/1.11.2
164        0.02%  curl/7.21.2 (x86_64-mandriva-linux-gnu) libcurl/7.21.2 OpenSSL/1.0.0a zlib/1.2.3 libidn/1.18 libssh2/1.2.5
164        0.02%  lftp/4.0.9
142        0.02%  Debian APT-HTTP/1.3 (0.8.16~exp12ubuntu10.2)
138        0.02%  HTTP-Tiny/0.025
137        0.02%  Debian APT-HTTP/1.3 (0.8.10.3)
117        0.02%  urlgrabber/3.1.0 yum/3.2.22
115        0.02%  curl/7.24.0 (x86_64-mageia-linux-gnu) libcurl/7.24.0 OpenSSL/1.0.0k zlib/1.2.6 libidn/1.24 libssh2/1.4.0
105        0.02%  Sogou web spider/4.0(+http://www.sogou.com/docs/help/webmasters.htm#07)
104        0.02%  Debian APT-HTTP/1.3 (0.9.7.5ubuntu5)
87         0.01%  curl/7.18.0 (i586-mandriva-linux-gnu) libcurl/7.18.0 OpenSSL/0.9.8g zlib/1.2.3 libidn/1.5 libssh2/0.18
83         0.01%  Java/1.7.0_21
74         0.01%  KDDI-CA31 UP.Browser/6.2.0.7.3.129 (GUI) MMP/2.0 (compatible; ichiro/mobile goo;+http://search.goo.ne.jp/option/use/sub4/sub4-1/)
69         0.01%  curl/7.28.1
64         0.01%  curl/7.24.0 (i586-mageia-linux-gnu) libcurl/7.24.0 OpenSSL/1.0.0k zlib/1.2.6 libidn/1.24 libssh2/1.4.0
62         0.01%  curl/7.19.0 (i586-mandriva-linux-gnu) libcurl/7.19.0 OpenSSL/0.9.8h zlib/1.2.3 libidn/1.10 libssh2/0.18
55         0.01%  Mozilla/4.0 (compatible;)
54         0.01%  Debian APT-HTTP/1.3 (0.8.3ubuntu7.1)
52         0.01%  curl/7.19.4 (i686-mandriva-linux-gnu) libcurl/7.19.4 GnuTLS/2.4.1 zlib/1.2.3 c-ares/1.5.2 libidn/1.10 libssh2/1.0
44         0.01%  Math. Comp. PA Crawler
43         0.01%  CCBot/2.0
43         0.01%  HTTP-Tiny/0.017
43         0.01%  Python-urllib/2.6
41         0.01%  Java/1.7.0_25
36         0.01%  urlgrabber/3.9.1
35         0.01%  libwww-perl/5.805
33         0.00%  curl/7.21.7 (x86_64-mandriva-linux-gnu) libcurl/7.21.7 OpenSSL/1.0.0d zlib/1.2.5 libidn/1.22 libssh2/1.2.8
32         0.00%  curl/7.19.7 (x86_64-redhat-linux-gnu) libcurl/7.19.7 NSS/3.14.0.0 zlib/1.2.3 libidn/1.18 libssh2/1.4.2
30         0.00%  curl/7.15.5 (x86_64-redhat-linux-gnu) libcurl/7.15.5 OpenSSL/0.9.8b zlib/1.2.3 libidn/0.6.5
28         0.00%  Debian APT-HTTP/1.3 (0.8.13.2ubuntu4.4)
28         0.00%  Debian APT-HTTP/1.3 (0.8.16~exp12ubuntu10.6)
26         0.00%  Debian APT-HTTP/1.3 (0.8.13.2ubuntu2)
20         0.00%  Mozilla/4.0 (compatible; MSIE 8.0; Windows NT 6.1; WOW64; Trident/4.0; SLCC2; Media Center PC 6.0; InfoPath.2; MS-RTC LM 8)
20         0.00%  Wget/1.13.4 (linux-gnu)
16         0.00%  PHP/5.2.10
16         0.00%  ia_archiver (+http://www.alexa.com/site/help/webmasters; crawler@alexa.com)
14         0.00%  curl/7.19.7 (i386-redhat-linux-gnu) libcurl/7.19.7 NSS/3.14.0.0 zlib/1.2.3 libidn/1.18 libssh2/1.4.2
13         0.00%  Mozilla/4.0 (compatible; MSIE 8.0; Windows NT 5.1; Trident/4.0)
12         0.00%  Aboundex/0.2 (http://www.aboundex.com/crawler/)
12         0.00%  Debian APT-HTTP/1.3 (0.8.16~exp5ubuntu13.6)
11         0.00%  BTWebClient/3210
9          0.00%  Chef Client/10.26.0 (ruby-1.8.7-p352; ohai-6.14.0; x86_64-linux; +http://opscode.com)
9          0.00%  Chef Client/11.4.4 (ruby-1.9.3-p286; ohai-6.16.0; x86_64-linux; +http://opscode.com)
9          0.00%  Python-urllib/2.7
9          0.00%  curl/7.19.7 (i386-redhat-linux-gnu) libcurl/7.19.7 NSS/3.13.6.0 zlib/1.2.3 libidn/1.18 libssh2/1.4.2
9          0.00%  curl/7.24.0 (i586-mandriva-linux-gnu) libcurl/7.24.0 OpenSSL/1.0.0d zlib/1.2.5 libidn/1.22 libssh2/1.2.9
8          0.00%  Lynx/2.8.5rel.1 libwww-FM/2.14 SSL-MM/1.4.1 GNUTLS/1.4.4
8          0.00%  Mozilla/4.0 (compatible; MSIE 8.0; Windows NT 5.1; Trident/4.0; .NET CLR 1.1.4322)
7          0.00%  Mozilla/4.0 (compatible; MSIE 8.0; Windows NT 6.0; Trident/4.0)
7          0.00%  NCBot (http://netcomber.com : tool for finding true domain owners) Queries/complaints: bot@netcomber.com
7          0.00%  Ubuntu APT-HTTP/1.3 (0.7.25.3ubuntu7)
6          0.00%  Chef Client/10.26.0 (ruby-1.9.3-p286; ohai-6.16.0; x86_64-linux; +http://opscode.com)
6          0.00%  HTTP-Tiny/0.029
6          0.00%  Sosospider+(+http://help.soso.com/webspider.htm)
6          0.00%  Ubuntu APT-HTTP/1.3 (0.7.23.1ubuntu2)
6          0.00%  curl/7.19.7 (x86_64-redhat-linux-gnu) libcurl/7.19.7 NSS/3.13.6.0 zlib/1.2.3 libidn/1.18 libssh2/1.4.2
6          0.00%  rpm/4.4.2.3
6          0.00%  smart/1.4.1
5          0.00%  Chef Client/11.2.0 (ruby-1.9.3-p286; ohai-6.16.0; x86_64-linux; +http://opscode.com)
5          0.00%  Debian APT-HTTP/1.3 (0.8.13.2ubuntu4.2)
5          0.00%  HTTP-Tiny/0.031
5          0.00%  ZmEu
4          0.00%  AppEngine-Google; (+http://code.google.com/appengine; appid: s~imgdaili4)
4          0.00%  Chef Client/11.4.0 (ruby-1.8.7-p352; ohai-6.16.0; x86_64-linux; +http://opscode.com)
4          0.00%  Chef Client/11.4.0 (ruby-1.9.3-p286; ohai-6.16.0; i686-linux; +http://opscode.com)
4          0.00%  Chef Client/11.4.0 (ruby-1.9.3-p286; ohai-6.16.0; x86_64-linux; +http://opscode.com)
4          0.00%  Mozilla/4.0 (compatible; MSIE 8.0; Windows NT 5.1; Trident/4.0; MRA 6.0 (build 5993); MRA 8.0 (build 5784); InfoPath.2)
4          0.00%  curl/7.19.7 (x86_64-redhat-linux-gnu) libcurl/7.19.7 NSS/3.13.1.0 zlib/1.2.3 libidn/1.18 libssh2/1.2.2
4          0.00%  curl/7.24.0 (i386-portbld-freebsd8.3) libcurl/7.24.0 OpenSSL/1.0.1e zlib/1.2.3 libidn/1.26 libssh2/1.4.3
4          0.00%  urlgrabber/3.9.1 yum/3.4.3
4          0.00%  w3m/0.5.1+cvs-1.946
3          0.00%  BTWebClient/340B(29785)
3          0.00%  Chef Client/10.14.2 (ruby-1.8.7-p352; ohai-6.14.0; i386-linux; +http://opscode.com)
3          0.00%  Cloud mapping experiment. Contact research@pdrlabs.net
3          0.00%  Debian APT-HTTP/1.3 (0.9.7.9)
3          0.00%  Mozilla/4.0
3          0.00%  Mozilla/4.0 (compatible; MSIE 8.0; Windows NT 5.2; Trident/4.0; .NET CLR 1.1.4322)
3          0.00%  Mozilla/4.0 (compatible; MSIE 8.0; Windows NT 6.1)
3          0.00%  Mozilla/4.0 (compatible; MSIE 8.0; Windows NT 6.1; WOW64; Trident/4.0; SLCC2; msn OptimizedIE8;ZHCN)
3          0.00%  Mozilla/4.0 (compatible; Netcraft Web Server Survey)
3          0.00%  My Nutch Spider/Nutch-1.6
3          0.00%  Ubuntu APT-HTTP/1.3 (0.7.25.3ubuntu9.13)
3          0.00%  Yeti/1.0 (NHN Corp.; http://help.naver.com/robots/)
3          0.00%  curl/7.21.7 (x86_64-mandriva-linux-gnu) libcurl/7.21.7 OpenSSL/1.0.0i zlib/1.2.7 libidn/1.22 libssh2/1.2.9
3          0.00%  curl/7.24.0 (x86_64-apple-darwin12.0) libcurl/7.24.0 OpenSSL/0.9.8x zlib/1.2.5
3          0.00%  facebookexternalhit/1.1 (+http://www.facebook.com/externalhit_uatext.php)
3          0.00%  libwww-perl/5.833
3          0.00%  libwww-perl/6.02
2          0.00%  Chef Client/10.14.2 (ruby-1.9.3-p194; ohai-6.14.0; x86_64-linux; +http://opscode.com)
2          0.00%  ELinks/0.12pre5 (textmode; Linux; 185x42-2)
2          0.00%  Goldfire Server
2          0.00%  HTTPClient/1.0 (2.3.3, ruby 1.9.3 (2013-02-22))
2          0.00%  Java/1.6.0_10
2          0.00%  Java/1.6.0_35
2          0.00%  MSIE9
2          0.00%  Mediapartners-Google
2          0.00%  Mozilla/4.0 (compatible; MSIE 8.0; Windows NT 6.2; Trident/4.0; SLCC2; Media Center PC 6.0)
2          0.00%  Mozilla/4.0 (compatible; MSIE8.0; Windows NT 6.0) .NET CLR 2.0.50727)
2          0.00%  OurBrowser/1.0 (Some Name)
2          0.00%  Python-urllib/1.17
2          0.00%  Ruby
2          0.00%  Wget/1.14 (freebsd9.1)
2          0.00%  curl/7.19.7 (i386-redhat-linux-gnu) libcurl/7.19.7 NSS/3.13.1.0 zlib/1.2.3 libidn/1.18 libssh2/1.2.2
2          0.00%  curl/7.19.7 (x86_64-unknown-linux-gnu) libcurl/7.19.7 NSS/3.12.6.2 zlib/1.2.3 libidn/1.18 libssh2/1.2.2
2          0.00%  curl/7.19.7 (x86_64-unknown-linux-gnu) libcurl/7.19.7 NSS/3.12.7.0 zlib/1.2.3 libidn/1.18 libssh2/1.2.2
2          0.00%  libwww-perl/6.01
2          0.00%  linkdex.com/v2.0
1          0.00%  Chef Client/10.12.0 (ruby-1.8.7-p352; ohai-6.14.0; x86_64-linux; +http://opscode.com)
1          0.00%  Chef Client/10.16.2 (ruby-1.8.7-p352; ohai-6.14.0; x86_64-linux; +http://opscode.com)
1          0.00%  Chef Client/10.18.2 (ruby-1.8.7-p352; ohai-6.16.0; x86_64-linux; +http://opscode.com)
1          0.00%  Chef Client/10.24.0 (ruby-1.9.3-p286; ohai-6.16.0; x86_64-linux; +http://opscode.com)
1          0.00%  Chef Client/11.4.0 (ruby-1.9.2-p180; ohai-6.16.0; x86_64-linux; +http://opscode.com)
1          0.00%  Debian APT-HTTP/1.3 (0.9.7.8)
1          0.00%  EMail Exractor
1          0.00%  File::Fetch/0.32
1          0.00%  Lynx/2.8.6rel.5 libwww-FM/2.14 SSL-MM/1.4.1 OpenSSL/1.0.0-fips
1          0.00%  Mozilla/4.0 (compatible; ICS)
1          0.00%  Mozilla/4.0 (compatible; MSIE 8.0; Windows NT 5.1; Trident/4.0; .NET CLR 2.0.50727)
1          0.00%  Mozilla/4.0 (compatible; MSIE 8.0; Windows NT 6.0)
1          0.00%  NCSA Mosaic/1.0 (X11;SunOS 4.1.4 sun4m)
1          0.00%  PycURL/7.26.0
1          0.00%  Yanadoo
1          0.00%  ZS%20Prepare/1.1 CFNetwork/548.1.4 Darwin/11.0.0
1          0.00%  curl/7.19.7 (i386-redhat-linux-gnu) libcurl/7.19.7 NSS/3.12.6.2 zlib/1.2.3 libidn/1.18 libssh2/1.2.2
1          0.00%  curl/7.19.7 (i686-pc-linux-gnu) libcurl/7.19.7 NSS/3.12.7.0 zlib/1.2.3 libidn/1.18 libssh2/1.2.2
1          0.00%  curl/7.27.0
1          0.00%  siclab (cboc-test@lab.ntt.co.jp)