Pages      User Agent
----------------  ----------------------

51979      6.15%  Spider: Googlebot
37191      4.40%  Browser: Netscape 4.8
2304       0.27%  Browser: Firefox
2077       0.25%  Browser: Internet Explorer 5.21 (Mac)
1800       0.21%  Browser: Internet Explorer 5.0
1389       0.16%  Browser: Safari (OSX)
842        0.10%  Browser: Internet Explorer 7.0 (Win)
767        0.09%  Browser: Internet Explorer 6.0 (Win)
502        0.06%  Browser: Opera
441        0.05%  Browser: Internet Explorer 3.0  (win95)
384        0.05%  Spider: MSNBot
18         0.00%  Browser: Internet Explorer 5.5 (Win)
6          0.00%  Browser: Mozilla 1.x
4          0.00%  Browser: Internet Explorer 5.01
2          0.00%  Browser: Internet Explorer 4.01
2          0.00%  Browser: Netscape 4.5
2          0.00%  Browser: Netscape v3.xx
1          0.00%  Browser: Konqueror
1          0.00%  Browser: Netscape v1.xx

274845    32.50%  mirrormanager-crawler/0.1 (+http://fedorahosted.org/mirrormanager)
245140    28.99%  Debian APT-HTTP/1.3 (0.9.7.7ubuntu4)
47034      5.56%  MirrorBrain Scanner/2.17.0 (See http://mirrorbrain.org/scanner_info)
18919      2.24%  MirrorBrain Probe (see http://mirrorbrain.org/probe_info)
18117      2.14%  Debian APT-HTTP/1.3 (0.8.16~exp12ubuntu10.10)
10313      1.22%  Debian APT-HTTP/1.3 (0.8.16~exp12ubuntu10.11)
7409       0.88%  curl/7.29.0
2926       0.35%  Debian APT-HTTP/1.3 (0.8.16~exp5ubuntu13.7)
2855       0.34%  TurnitinBot/2.1 (http://www.turnitin.com/robot/crawlerinfo.html)
2648       0.31%  curl/7.21.7 (x86_64-mandriva-linux-gnu) libcurl/7.21.7 OpenSSL/1.0.0d zlib/1.2.5 libidn/1.22 libssh2/1.2.9
2583       0.31%  CentOSIPv6mirrorchecker/4.0; centos at miuku dot net
1867       0.22%  curl/7.21.7 (x86_64-mandriva-linux-gnu) libcurl/7.21.7 OpenSSL/1.0.0i zlib/1.2.5 libidn/1.22 libssh2/1.2.9
1700       0.20%  curl/7.21.7 (i586-mandriva-linux-gnu) libcurl/7.21.7 OpenSSL/1.0.0d zlib/1.2.5 libidn/1.22 libssh2/1.2.9
1690       0.20%  Debian APT-HTTP/1.3 (0.8.16~exp12ubuntu10.12)
1562       0.18%  Wget/1.12 (linux-gnu)
1552       0.18%  Debian APT-HTTP/1.3 (0.9.7.5ubuntu5.1)
1494       0.18%  curl/7.21.7 (i586-mandriva-linux-gnu) libcurl/7.21.7 OpenSSL/1.0.0i zlib/1.2.5 libidn/1.22 libssh2/1.2.9
1440       0.17%  Debian APT-HTTP/1.3 (0.8.16~exp12ubuntu10.7)
1182       0.14%  curl/7.20.1 (i586-mandriva-linux-gnu) libcurl/7.20.1 OpenSSL/1.0.0a zlib/1.2.3 libidn/1.18 libssh2/1.2.5
1041       0.12%  libwww-perl/6.04
1016       0.12%  libwww-perl/6.05
867        0.10%  PycURL/7.29.0
728        0.09%  Debian APT-HTTP/1.3 (0.8.16~exp12ubuntu10)
711        0.08%  Wget/1.14 (linux-gnu)
691        0.08%  lftp/3.7.11
656        0.08%  libwww-perl/6.03
649        0.08%  curl/7.19.6 (i586-mandriva-linux-gnu) libcurl/7.19.6 OpenSSL/0.9.8k zlib/1.2.3 libidn/1.15 libssh2/1.2.1
627        0.07%  PycURL/7.19.7
596        0.07%  curl/7.21.2 (i686-mandriva-linux-gnu) libcurl/7.21.2 OpenSSL/1.0.0a zlib/1.2.3 libidn/1.18 libssh2/1.2.5
590        0.07%  Wget/1.11.4
567        0.07%  curl/7.21.7 (i586-mandriva-linux-gnu) libcurl/7.21.7 OpenSSL/1.0.0d zlib/1.2.5 libidn/1.22 libssh2/1.2.8
546        0.06%  Debian APT-HTTP/1.3 (0.8.16~exp12ubuntu10.5)
480        0.06%  Mozilla/4.0 (compatible; ipMonitor 9.0)
441        0.05%  HTTP-Tiny/0.012
424        0.05%  aria2/1.11.2
375        0.04%  curl/7.26.0
338        0.04%  Wget/1.11.4 Red Hat modified
329        0.04%  curl/7.20.1 (x86_64-mandriva-linux-gnu) libcurl/7.20.1 OpenSSL/1.0.0a zlib/1.2.3 libidn/1.18 libssh2/1.2.5
319        0.04%  zif
301        0.04%  aria2/1.9.0
256        0.03%  urlgrabber/3.9.1 yum/3.2.29
252        0.03%  Debian APT-HTTP/1.3 (0.8.3ubuntu7.3)
216        0.03%  lftp/4.0.9
206        0.02%  Debian APT-HTTP/1.3 (0.8.16~exp12ubuntu10.2)
187        0.02%  Aboundex/0.3 (http://www.aboundex.com/crawler/)
168        0.02%  Ubuntu APT-HTTP/1.3 (0.7.25.3ubuntu9.14)
152        0.02%  Debian APT-HTTP/1.3 (0.8.10.3)
146        0.02%  Wget/1.13.4 (linux-gnu)
136        0.02%  Debian APT-HTTP/1.3 (0.8.13.2ubuntu4.1)
136        0.02%  DoCoMo/2.0 P900i(c100;TB;W24H11) (compatible; ichiro/mobile goo;+http://search.goo.ne.jp/option/use/sub4/sub4-1/)
127        0.02%  Debian APT-HTTP/1.3 (0.9.7.5ubuntu5)
123        0.01%  Java/1.7.0_25
123        0.01%  urlgrabber/3.1.0 yum/3.2.22
111        0.01%  HTTP-Tiny/0.017
99         0.01%  curl/7.28.1
73         0.01%  Sogou web spider/4.0(+http://www.sogou.com/docs/help/webmasters.htm#07)
70         0.01%  curl/7.24.0 (i586-mandriva-linux-gnu) libcurl/7.24.0 OpenSSL/1.0.0i zlib/1.2.5 libidn/1.22 libssh2/1.2.9
69         0.01%  curl/7.19.4 (i686-mandriva-linux-gnu) libcurl/7.19.4 GnuTLS/2.4.1 zlib/1.2.3 c-ares/1.5.2 libidn/1.10 libssh2/1.0
68         0.01%  HTTP-Tiny/0.025
63         0.01%  Mozilla/4.0 (compatible;)
63         0.01%  Python-urllib/2.6
51         0.01%  curl/7.18.0 (i586-mandriva-linux-gnu) libcurl/7.18.0 OpenSSL/0.9.8g zlib/1.2.3 libidn/1.5 libssh2/0.18
48         0.01%  Debian APT-HTTP/1.3 (0.8.16~exp5ubuntu13.3)
48         0.01%  urlgrabber/3.9.1
41         0.00%  Java/1.4.1_04
40         0.00%  curl/7.21.7 (x86_64-mandriva-linux-gnu) libcurl/7.21.7 OpenSSL/1.0.0d zlib/1.2.5 libidn/1.22 libssh2/1.2.8
40         0.00%  libwww-perl/5.805
38         0.00%  libwww-perl/5.833
37         0.00%  curl/7.19.0 (i586-mandriva-linux-gnu) libcurl/7.19.0 OpenSSL/0.9.8h zlib/1.2.3 libidn/1.10 libssh2/0.18
34         0.00%  Debian APT-HTTP/1.3 (0.8.13.2ubuntu4.6)
33         0.00%  curl/7.19.7 (x86_64-redhat-linux-gnu) libcurl/7.19.7 NSS/3.14.0.0 zlib/1.2.3 libidn/1.18 libssh2/1.4.2
31         0.00%  curl/7.19.7 (i386-redhat-linux-gnu) libcurl/7.19.7 NSS/3.14.0.0 zlib/1.2.3 libidn/1.18 libssh2/1.4.2
28         0.00%  Debian APT-HTTP/1.3 (0.8.13.2ubuntu4)
27         0.00%  Debian APT-HTTP/1.3 (0.8.3ubuntu7.1)
27         0.00%  HTTP-Tiny/0.034
25         0.00%  curl/7.21.2 (x86_64-mandriva-linux-gnu) libcurl/7.21.2 OpenSSL/1.0.0a zlib/1.2.3 libidn/1.18 libssh2/1.2.5
24         0.00%  Debian APT-HTTP/1.3 (0.8.16~exp5ubuntu13)
24         0.00%  Debian APT-HTTP/1.3 (1.8.17bodhi1)
21         0.00%  curl/7.21.2 (i686-mandriva-linux-gnu) libcurl/7.21.2 OpenSSL/1.0.0a zlib/1.2.5 libidn/1.18 libssh2/1.2.5
20         0.00%  curl/7.19.7 (x86_64-redhat-linux-gnu) libcurl/7.19.7 NSS/3.13.6.0 zlib/1.2.3 libidn/1.18 libssh2/1.4.2
18         0.00%  PHP/5.2.10
18         0.00%  curl/7.15.5 (x86_64-redhat-linux-gnu) libcurl/7.15.5 OpenSSL/0.9.8b zlib/1.2.3 libidn/0.6.5
17         0.00%  Mozilla/4.0 (compatible; MSIE 8.0; Windows NT 5.1; Trident/4.0)
16         0.00%  Chef Client/11.4.4 (ruby-1.9.3-p286; ohai-6.16.0; x86_64-linux; +http://opscode.com)
16         0.00%  Wget/1.13.4 (linux-gnueabihf)
16         0.00%  libwww-perl/5.836
15         0.00%  Ubuntu APT-HTTP/1.3 (0.7.25.3ubuntu9.13)
14         0.00%  ZmEu
13         0.00%  Chef Client/10.26.0 (ruby-1.8.7-p352; ohai-6.14.0; x86_64-linux; +http://opscode.com)
12         0.00%  Debian APT-HTTP/1.3 (0.8.16~exp12ubuntu10.3)
12         0.00%  Python-urllib/1.17
12         0.00%  binlar_2.6.3 test@mgmt.mic
11         0.00%  lftp/4.3.3
10         0.00%  HTTP-Tiny/0.024
9          0.00%  Cloud mapping experiment. Contact research@pdrlabs.net
9          0.00%  curl/7.28.0
8          0.00%  libwww-perl/6.01
8          0.00%  siclab (cboc-test@lab.ntt.co.jp)
8          0.00%  www.integromedb.org/Crawler
7          0.00%  Apache-HttpAsyncClient/4.0-beta4 (java 1.5)
7          0.00%  BTWebClient/3200
7          0.00%  curl/7.19.6 (i586-mandriva-linux-gnu) libcurl/7.19.6 OpenSSL/0.9.8k zlib/1.2.5 libidn/1.15 libssh2/1.2.1
6          0.00%  Chef Client/11.2.0 (ruby-1.9.3-p286; ohai-6.16.0; x86_64-linux; +http://opscode.com)
6          0.00%  Mozilla/4.0 (compatible; MSIE 8.0; Windows NT 5.1; Trident/4.0; .NET CLR 1.1.4322)
6          0.00%  aria2/1.16.0
6          0.00%  ia_archiver (+http://www.alexa.com/site/help/webmasters; crawler@alexa.com)
6          0.00%  libwww-perl/6.02
5          0.00%  Chef Client/10.26.0 (ruby-1.9.3-p286; ohai-6.16.0; x86_64-linux; +http://opscode.com)
5          0.00%  Debian APT-HTTP/1.3 (0.8.13.2ubuntu4.2)
5          0.00%  Mozilla/4.0 (compatible; MSIE 8.0; Windows NT 5.2; Trident/4.0; .NET CLR 1.1.4322)
5          0.00%  Xenu Link Sleuth/1.3.8
5          0.00%  Yeti/1.0 (NHN Corp.; http://help.naver.com/robots/)
4          0.00%  HTTP-Tiny/0.029
4          0.00%  Mozilla/4.0
4          0.00%  Python-urllib/2.7
4          0.00%  Ubuntu APT-HTTP/1.3 (0.7.25.3ubuntu9.4)
4          0.00%  Wget/ (linux-gnu)
4          0.00%  curl/7.19.6 (x86_64-mandriva-linux-gnu) libcurl/7.19.6 OpenSSL/0.9.8k zlib/1.2.3 libidn/1.15 libssh2/1.2.1
4          0.00%  curl/7.19.7 (i386-redhat-linux-gnu) libcurl/7.19.7 NSS/3.13.6.0 zlib/1.2.3 libidn/1.18 libssh2/1.4.2
4          0.00%  curl/7.19.7 (x86_64-redhat-linux-gnu) libcurl/7.19.7 NSS/3.13.1.0 zlib/1.2.3 libidn/1.18 libssh2/1.2.2
4          0.00%  curl/7.24.0 (x86_64-apple-darwin12.0) libcurl/7.24.0 OpenSSL/0.9.8x zlib/1.2.5
4          0.00%  facebookexternalhit/1.1 (+http://www.facebook.com/externalhit_uatext.php)
4          0.00%  libwww-perl/5.837
3          0.00%  Goldfire Server
3          0.00%  Mozilla/4.0 (compatible; MSIE 8.0; Windows NT 6.1)
3          0.00%  PycURL/7.26.0
3          0.00%  WordPress/3.5.2; http://arhiva.gentoo-land.org
3          0.00%  curl/7.24.0 (i586-mageia-linux-gnu) libcurl/7.24.0 OpenSSL/1.0.0k zlib/1.2.6 libidn/1.24 libssh2/1.4.0
3          0.00%  libwww-perl/5.823
3          0.00%  rpm/4.4.2.3
3          0.00%  smart/1.3
2          0.00%  Chef Client/10.14.2 (ruby-1.8.7-p352; ohai-6.14.0; i386-linux; +http://opscode.com)
2          0.00%  Chef Client/10.14.2 (ruby-1.9.3-p194; ohai-6.14.0; x86_64-linux; +http://opscode.com)
2          0.00%  Chef Client/10.16.2 (ruby-1.8.7-p352; ohai-6.14.0; x86_64-linux; +http://opscode.com)
2          0.00%  CloudACL/Nutch-1.4
2          0.00%  ELinks/0.11.1 (textmode; Linux; -)
2          0.00%  HTTPClient/1.0 (2.3.3, ruby 1.9.3 (2013-02-22))
2          0.00%  Java/1.7.0_21
2          0.00%  Microsoft URL Control - 6.01.9782
2          0.00%  Mozilla/0.6 Beta (Windows)
2          0.00%  Mozilla/4.0 (compatible; MSIE 8.0; Windows NT 6.0)
2          0.00%  Mozilla/4.0 (compatible; MSIE 8.0; Windows NT 6.1; WOW64; Trident/4.0; SLCC2; Media Center PC 6.0; InfoPath.2; MS-RTC LM 8)
2          0.00%  PagesInventory (robot +http://www.pagesinventory.com)
2          0.00%  Ruby
2          0.00%  Ubuntu APT-HTTP/1.3 (0.7.23.1ubuntu2)
2          0.00%  UnwindFetchor/1.0 (+http://www.gnip.com/)
2          0.00%  Uzbl (Webkit 1.8) (Linux i686 [i686])
2          0.00%  WordPress/3.5.2; http://4g.16mb.com
2          0.00%  Xenu Link Sleuth/1.3.9 beta
2          0.00%  curl/7.19.7 (i386-redhat-linux-gnu) libcurl/7.19.7 NSS/3.13.1.0 zlib/1.2.3 libidn/1.18 libssh2/1.2.2
2          0.00%  larbin_2.6.3 larbin2.6.3@unspecified.mail
2          0.00%  yacybot (freeworld/global; amd64 Linux 3.2.0-4-amd64; java 1.7.0_03; Etc/de) http://yacy.net/bot.html
2          0.00%  yacybot (freeworld/global; amd64 Linux 3.7.10-gentoo-r1; java 1.7.0_21; Europe/pl) http://yacy.net/bot.html
1          0.00%  AppEngine-Google; (+http://code.google.com/appengine; appid: s~pp8gg6)
1          0.00%  AppEngine-Google; (+http://code.google.com/appengine; appid: s~pp8gg9)
1          0.00%  Chef Client/10.16.6 (ruby-1.8.7-p352; ohai-6.14.0; x86_64-linux; +http://opscode.com)
1          0.00%  Chef Client/10.18.2 (ruby-1.9.2-p180; ohai-6.16.0; x86_64-linux; +http://opscode.com)
1          0.00%  Chef Client/10.24.0 (ruby-1.9.3-p286; ohai-6.16.0; x86_64-linux; +http://opscode.com)
1          0.00%  Chef Client/11.4.0 (ruby-1.8.7-p253; ohai-6.16.0; x86_64-linux; +http://opscode.com)
1          0.00%  Chef Client/11.4.0 (ruby-1.8.7-p352; ohai-6.16.0; x86_64-linux; +http://opscode.com)
1          0.00%  Chef Client/11.4.0 (ruby-1.9.3-p286; ohai-6.16.0; i686-linux; +http://opscode.com)
1          0.00%  Chef Client/11.4.0 (ruby-1.9.3-p286; ohai-6.16.0; x86_64-linux; +http://opscode.com)
1          0.00%  Chef Client/11.4.4 (ruby-1.9.3-p286; ohai-6.16.0; x86_64-linux; +http://opscode.com) BMID/E67A290558
1          0.00%  Chef Client/11.6.0 (ruby-1.9.3-p429; ohai-6.18.0; x86_64-linux; +http://opscode.com)
1          0.00%  Debian APT-HTTP/1.3 (0.8.13.2ubuntu2)
1          0.00%  Debian APT-HTTP/1.3 (0.9.7.9)
1          0.00%  ELinks/0.12pre5 (textmode; Linux; 177x54-2)
1          0.00%  ELinks/0.12pre5 (textmode; Linux; 80x25-2)
1          0.00%  EMail Exractor
1          0.00%  LinksCrawler 0.1beta
1          0.00%  Lynx/2.8.5rel.1 libwww-FM/2.14 SSL-MM/1.4.1 OpenSSL/0.9.8e-fips-rhel5
1          0.00%  MSIE9
1          0.00%  Mozilla/4.0 (compatible- MSIE 6.0- Windows NT 5.1- SV1- .NET CLR 1.1.4322
1          0.00%  Mozilla/4.0 (compatible; MSIE 8.0; Windows NT 5.1; Trident/4.0; MRA 6.0 (build 5993); MRA 8.0 (build 5784); InfoPath.2)
1          0.00%  My Nutch Spider/Nutch-1.6
1          0.00%  NCSA Mosaic/1.0 (X11;SunOS 4.1.4 sun4m)
1          0.00%  Wget/1.12 (solaris2.11)
1          0.00%  blogtop.us crawler - http://blogtop.us/
1          0.00%  curl/7.19.7 (i686-pc-linux-gnu) libcurl/7.19.7 NSS/3.13.1.0 zlib/1.2.3 libidn/1.18 libssh2/1.2.2
1          0.00%  curl/7.19.7 (x86_64-redhat-linux-gnu) libcurl/7.19.7 NSS/3.12.9.0 zlib/1.2.3 libidn/1.18 libssh2/1.2.2
1          0.00%  curl/7.19.7 (x86_64-unknown-linux-gnu) libcurl/7.19.7 NSS/3.12.7.0 zlib/1.2.3 libidn/1.18 libssh2/1.2.2
1          0.00%  libwww-perl/5.834
1          0.00%  nutch-1.4/Nutch-1.4
1          0.00%  rpm/4.2.3
1          0.00%  rpm/4.4.2
1          0.00%  unused/0 (VS920 GRK39F); gzip
1          0.00%  yacybot (freeworld/global; amd64 Linux 3.2.0-4-amd64; java 1.6.0_27; Europe/de) http://yacy.net/bot.html