Pages      User Agent
----------------  ----------------------

315433    13.35%  Browser: Netscape 4.8
7713       0.33%  Spider: Googlebot
7008       0.30%  Browser: Internet Explorer 5.0
6604       0.28%  Browser: Safari (OSX)
2027       0.09%  Browser: Firefox
1334       0.06%  Browser: Internet Explorer 6.0 (Win)
567        0.02%  Browser: Internet Explorer 5.21 (Mac)
50         0.00%  Browser: Internet Explorer 7.0 (Win)
42         0.00%  Browser: Internet Explorer 3.0  (win95)
32         0.00%  Browser: Internet Explorer 4.5
23         0.00%  Browser: Opera
15         0.00%  Browser: Netscape v3.xx
2          0.00%  Browser: Internet Explorer 5.5 (Win)
2          0.00%  Browser: Mozilla 1.x

571999    24.20%  MirrorBrain Scanner/2.18.1 (See http://mirrorbrain.org/scanner_info)
427889    18.10%  Debian APT-HTTP/1.3 (1.0.1ubuntu2)
334508    14.15%  Debian APT-HTTP/1.3 (0.9.9.1~ubuntu1)
232116     9.82%  Debian APT-HTTP/1.3 (1.0.9.8.3)
159669     6.76%  mirrormanager-crawler/0.1 (+http://fedorahosted.org/mirrormanager)
43426      1.84%  MirrorBrain Probe (see http://mirrorbrain.org/probe_info)
31769      1.34%  urlgrabber/3.10 yum/3.4.3
27959      1.18%  Debian APT-HTTP/1.3 (0.9.7.9)
21882      0.93%  Debian APT-HTTP/1.3 (1.0.9.7ubuntu4)
18053      0.76%  Debian APT-HTTP/1.3 (1.2.12)
16450      0.70%  Debian APT-HTTP/1.3 (1.0.10.2ubuntu1)
15479      0.65%  Wget/1.15 (linux-gnu)
11806      0.50%  Debian APT-HTTP/1.3 (1.0.9.8.2)
11253      0.48%  Debian APT-HTTP/1.3 (0.8.16~exp12ubuntu10.26)
9752       0.41%  Debian Apt-Cacher-NG/0.8.0
8549       0.36%  Debian APT-HTTP/1.3 (0.8.16~exp12ubuntu10.27)
7641       0.32%  Debian APT-HTTP/1.3 (1.0.9.2ubuntu2)
5753       0.24%  Debian Apt-Cacher-NG/0.7.27
5675       0.24%  Debian APT-HTTP/1.3 (0.9.7.7ubuntu4)
5132       0.22%  Debian APT-HTTP/1.3 (1.2.10)
4481       0.19%  Debian APT-HTTP/1.3 (1.0.9.8.1)
3318       0.14%  curl/7.30.0
3257       0.14%  CentOSIPv6mirrorchecker/4.0; centos at miuku dot net
2908       0.12%  Debian APT-HTTP/1.3 (0.8.16~exp12ubuntu10.22)
2550       0.11%  Debian APT-HTTP/1.3 (0.8.16~exp12ubuntu10.21)
2284       0.10%  Debian APT-HTTP/1.3 (0.8.16~exp12ubuntu10.16)
2209       0.09%  Debian APT-HTTP/1.3 (1.0.9.8)
1878       0.08%  Debian APT-HTTP/1.3 (0.8.16~exp12ubuntu10.25)
1539       0.07%  libwww-perl/6.05
1467       0.06%  Wget/1.14 (linux-gnu)
1447       0.06%  repoverge.net
1341       0.06%  Debian APT-HTTP/1.3 (0.8.16~exp12ubuntu10.17)
632        0.03%  urlgrabber/3.9.1 yum/3.2.29
608        0.03%  Debian APT-HTTP/1.3 (0.8.16~exp12ubuntu10.14)
581        0.02%  Debian APT-HTTP/1.3 (0.8.16~exp12ubuntu10.15)
575        0.02%  Wget/1.12 (linux-gnu)
552        0.02%  Wget/1.13.4 (linux-gnu)
514        0.02%  Debian APT-HTTP/1.3 (0.8.10.3)
458        0.02%  curl/7.21.2 (i686-mandriva-linux-gnu) libcurl/7.21.2 OpenSSL/1.0.0a zlib/1.2.3 libidn/1.18 libssh2/1.2.5
443        0.02%  Debian APT-HTTP/1.3 (0.8.16~exp12ubuntu10.12)
414        0.02%  Debian APT-HTTP/1.3 (0.8.16~exp12ubuntu10.19)
385        0.02%  libwww-perl/6.15
377        0.02%  Debian APT-HTTP/1.3 (0.8.16~exp12ubuntu10.24)
336        0.01%  Debian APT-HTTP/1.3 (0.8.16~exp12ubuntu10)
330        0.01%  libwww-perl/6.03
327        0.01%  HTTP-Tiny/0.025
322        0.01%  HTTP-Tiny/0.033
312        0.01%  Debian APT-HTTP/1.3 (0.8.16~exp12ubuntu10.23)
292        0.01%  apt-cacher/1.7.6 libcurl/7.26.0 GnuTLS/2.12.20 zlib/1.2.7 libidn/1.25 libssh2/1.4.2 librtmp/2.3
281        0.01%  Debian APT-HTTP/1.3 (1.2.14)
270        0.01%  Debian APT-HTTP/1.3 (1.3~pre2)
250        0.01%  Debian Apt-Cacher-NG/0.7.26
241        0.01%  curl/7.21.7 (x86_64-mandriva-linux-gnu) libcurl/7.21.7 OpenSSL/1.0.0d zlib/1.2.5 libidn/1.22 libssh2/1.2.8
239        0.01%  Wget/1.16 (linux-gnu)
237        0.01%  Artifactory/4.4.2
206        0.01%  Debian Apt-Cacher-NG/0.7.11
203        0.01%  Ubuntu APT-HTTP/1.3 (0.7.25.3ubuntu9.17.1)
192        0.01%  ltx71 - (http://ltx71.com/)
179        0.01%  ZmEu
175        0.01%  lftp/4.0.9
165        0.01%  curl/7.21.7 (i586-mandriva-linux-gnu) libcurl/7.21.7 OpenSSL/1.0.0d zlib/1.2.5 libidn/1.22 libssh2/1.2.8
164        0.01%  Cloud mapping experiment. Contact research@pdrlabs.net
156        0.01%  Java/1.6.0_04
140        0.01%  curl/7.40.0
132        0.01%  Debian APT-HTTP/1.3 (0.8.16~exp12ubuntu10.7)
124        0.01%  Debian Apt-Cacher-NG/0.9.1
120        0.01%  Debian APT-HTTP/1.3 (0.8.16~exp12ubuntu10.10)
120        0.01%  Debian APT-HTTP/1.3 (1.2.11)
109        0.00%  libwww-perl/6.04
108        0.00%  lftp/3.7.14
93         0.00%  Mozilla/4.0 (compatible; MSIE 8.0; Windows NT 5.1; Trident/4.0)
92         0.00%  Debian APT-HTTP/1.3 (0.9.7.5ubuntu5.1)
88         0.00%  Mozilla/4.0 (compatible; MSIE 9.0; Windows NT 6.1)
88         0.00%  urlgrabber/3.1.0 yum/3.2.22
73         0.00%  BTWebClient/3470
73         0.00%  Debian APT-HTTP/1.3 (0.8.13.2ubuntu4.6)
69         0.00%  libwww-perl/5.837
68         0.00%  urlgrabber/3.10
65         0.00%  Go-http-client/1.1
63         0.00%  libwww-perl/6.06
62         0.00%  python-requests/2.6.0 CPython/2.7.5 Linux/3.10.0-327.22.2.el7.x86_64
61         0.00%  libwww-perl/6.08
59         0.00%  ) { :;};/usr/bin/perl -e 'print 
58         0.00%  Debian APT-HTTP/1.3 (0.8.13.2ubuntu2)
58         0.00%  apt-cacher/1.6.12 libcurl/7.21.0 GnuTLS/2.8.6 zlib/1.2.3.4 libidn/1.15
57         0.00%  Sogou web spider/4.0(+http://www.sogou.com/docs/help/webmasters.htm#07)
57         0.00%  Wotbox/2.01 (+http://www.wotbox.com/bot/)
56         0.00%  Python-urllib/2.7
53         0.00%  Debian APT-HTTP/1.3 (1.2.6)
48         0.00%  Java/1.7.0_79
48         0.00%  PycURL/7.29.0
45         0.00%  Java/1.6.0_20
42         0.00%  betaBot
41         0.00%  iPXE/1.0.0+ (d0bfd)
39         0.00%  urlgrabber/3.9.1
36         0.00%  Wget/1.18 (linux-gnu)
35         0.00%  HTTP-Tiny/0.012
35         0.00%  HTTP-Tiny/0.054
35         0.00%  Python-urllib/2.6
32         0.00%  curl/7.17.1 (mips-unknown-linux-gnu) libcurl/7.17.1 OpenSSL/0.9.8i zlib/1.2.3
31         0.00%  Debian Apt-Cacher-NG/0.7.2
29         0.00%  curl/7.21.7 (x86_64-mandriva-linux-gnu) libcurl/7.21.7 OpenSSL/1.0.0d zlib/1.2.5 libidn/1.22 libssh2/1.2.9
28         0.00%  curl/7.19.7 (x86_64-redhat-linux-gnu) libcurl/7.19.7 NSS/3.14.0.0 zlib/1.2.3 libidn/1.18 libssh2/1.4.2
28         0.00%  curl/7.20.1 (i586-mandriva-linux-gnu) libcurl/7.20.1 OpenSSL/1.0.0a zlib/1.2.3 libidn/1.18 libssh2/1.2.5
27         0.00%  Ubuntu APT-HTTP/1.3 (0.7.25.3ubuntu9.13)
27         0.00%  ia_archiver
27         0.00%  python-requests/2.4.3 CPython/2.7.5 Linux/3.10.0-327.22.2.el7.x86_64
23         0.00%  Debian APT-HTTP/1.3 (1.0.9.3ubuntu1)
21         0.00%  Debian APT-HTTP/1.3 (1.0.1ubuntu2) BMID/E6802C0D7B
20         0.00%  HTTP-Tiny/0.017
18         0.00%  Lynx/2.8.8dev.12 libwww-FM/2.14 SSL-MM/1.4.1 GNUTLS/2.12.18
17         0.00%  libwww-perl/6.13
16         0.00%  lftp/3.7.11
15         0.00%  Debian APT-HTTP/1.3 (1.0.1ubuntu2) BMID/E6802C0E67
15         0.00%  Debian APT-HTTP/1.3 (1.0.1ubuntu2) BMID/E6802C156D
14         0.00%  libwww-perl/6.02
12         0.00%  Debian APT-HTTP/1.3 (1.3~exp3)
12         0.00%  \
10         0.00%  HTTP-Tiny/0.058
10         0.00%  Mozilla/4.0 (compatible;)
9          0.00%  Wget(linux)
8          0.00%  CCBot/2.0 (http://commoncrawl.org/faq/)
8          0.00%  GarlikCrawler/1.2 (http://garlik.com/, crawler@garlik.com)
7          0.00%  curl/7.37.0
7          0.00%  masscan/1.0
6          0.00%  Debian APT-HTTP/1.3 (1.0.1ubuntu2) BMID/E675CBAAC9
6          0.00%  Debian APT-HTTP/1.3 (1.0.1ubuntu2) BMID/E675CD123E
6          0.00%  Debian APT-HTTP/1.3 (1.0.1ubuntu2) BMID/E6802C0D7C
6          0.00%  Debian APT-HTTP/1.3 (1.0.1ubuntu2) BMID/E6802C11CB
6          0.00%  GigablastOpenSource/1.0
6          0.00%  Go http package
6          0.00%  Mozilla/4.0 (compatible; Netcraft Web Server Survey)
6          0.00%  PycURL/7.19.3 libcurl/7.37.1 GnuTLS/3.2.16 zlib/1.2.8 libidn/1.28 librtmp/2.3
6          0.00%  curl/7.29.0
5          0.00%  HTTP-Tiny/0.043
5          0.00%  curl/7.19.7 (i386-redhat-linux-gnu) libcurl/7.19.7 NSS/3.21 Basic ECC zlib/1.2.3 libidn/1.18 libssh2/1.4.2
4          0.00%  PycURL/7.19.3 libcurl/7.36.0 GnuTLS/2.12.23 zlib/1.2.8 libidn/1.28 libssh2/1.4.3 librtmp/2.3
4          0.00%  Scanbot
4          0.00%  Wget/1.17.1 (linux-gnu)
4          0.00%  YisouSpider
4          0.00%  curl/7.19.7 (x86_64-redhat-linux-gnu) libcurl/7.19.7 NSS/3.21 Basic ECC zlib/1.2.3 libidn/1.18 libssh2/1.4.2
4          0.00%  libwww-perl/5.805
4          0.00%  python-requests/2.4.3 CPython/2.7.5 Linux/3.10.0-327.18.2.el7.x86_64
4          0.00%  python-requests/2.6.0 CPython/2.7.5 Linux/3.10.0-327.18.2.el7.x86_64
3          0.00%  CakePHP
3          0.00%  Debian APT-HTTP/1.3 (1.0.1ubuntu2) BMID/E6802C1DBC
3          0.00%  Debian APT-HTTP/1.3 (1.1.10)
3          0.00%  Debian APT-HTTP/1.3 (1.3~exp1)
3          0.00%  Java/1.8.0_77
3          0.00%  Lynx/2.8.8pre.4 libwww-FM/2.14 SSL-MM/1.4.1 GNUTLS/2.12.23
3          0.00%  Mozilla/4.0 (compatible; MSIE 8.0; Windows NT 6.1; Trident/4.0))
3          0.00%  PycURL/7.19.5 libcurl/7.38.0 GnuTLS/3.3.8 zlib/1.2.8 libidn/1.29 libssh2/1.4.3 librtmp/2.3
3          0.00%  Telesphoreo
3          0.00%  masscan/1.0 (https://github.com/robertdavidgraham/masscan)
3          0.00%  nutch-1.4/Nutch-1.4
3          0.00%  python-requests/2.9.0
3          0.00%  the beast
2          0.00%  ) { :; }; /bin/bash -c 
2          0.00%  Aboundex/0.3 (http://www.aboundex.com/crawler/)
2          0.00%  Debian APT-HTTP/1.3 (1.2.13)
2          0.00%  Google-HTTP-Java-Client/1.17.0-rc (gzip)
2          0.00%  Lynx/2.8.5rel.1 libwww-FM/2.15FC SSL-MM/1.4.1c OpenSSL/0.9.7e-dev
2          0.00%  Mechanize/2.7.2 Ruby/1.9.3p551 (http://github.com/sparklemotion/mechanize/)
2          0.00%  Microsoft Office Excel 2013
2          0.00%  PycURL/7.19.3 libcurl/7.47.0 GnuTLS/3.4.13 zlib/1.2.8 libidn/1.28 libssh2/1.4.3 nghttp2/1.11.1 librtmp/2.3
2          0.00%  Ubuntu APT-HTTP/1.3 (0.7.25.3ubuntu9.5)
2          0.00%  curl/7.15.5 (x86_64-redhat-linux-gnu) libcurl/7.15.5 OpenSSL/0.9.8b zlib/1.2.3 libidn/0.6.5
2          0.00%  curl/7.19.7 (x86_64-redhat-linux-gnu) libcurl/7.19.7 NSS/3.19.1 Basic ECC zlib/1.2.3 libidn/1.18 libssh2/1.4.2
2          0.00%  curl/7.21.7 (i586-mandriva-linux-gnu) libcurl/7.21.7 OpenSSL/1.0.0d zlib/1.2.8 libidn/1.22 libssh2/1.2.8
2          0.00%  iPXE/1.0.0+ (86285)
2          0.00%  libwww-perl/5.834
2          0.00%  www.probethenet.com scanner
1          0.00%  BlackBerry9000/4.6.0.167 Profile/MIDP-2.0 Configuration/CLDC-1.1 VendorID/102 ips-agent
1          0.00%  Debian APT-HTTP/1.3 (0.8.16~exp12ubuntu10.20.1)
1          0.00%  Debian APT-HTTP/1.3 (0.8.3ubuntu7)
1          0.00%  Java/1.7.0_80
1          0.00%  Mozilla-1.1
1          0.00%  Mozilla/4.0 (compatible; Clever Internet Suite)
1          0.00%  Mozilla/4.0 (compatible; MSIE 8.0; Windows NT 5.1; Trident/4.0; .NET CLR 1.1.4322; .NET CLR 2.0.50727)
1          0.00%  None
1          0.00%  PycURL/7.19.3 libcurl/7.38.0 GnuTLS/3.2.16 zlib/1.2.8 libidn/1.28 librtmp/2.3
1          0.00%  PycURL/7.19.5 libcurl/7.38.0 GnuTLS/3.3.8 zlib/1.2.8 libidn/1.28 librtmp/2.3
1          0.00%  Stratagems Kumo
1          0.00%  TelegramBot (like TwitterBot)
1          0.00%  Ubuntu APT-HTTP/1.3 (0.7.25.3ubuntu7)
1          0.00%  Wget/1.11.4 Red Hat modified
1          0.00%  WordPress/4.3.5; http://blog.nsb.northants.sch.uk; verifying pingback from 191.96.249.54
1          0.00%  Xenu Link Sleuth/1.3.8
1          0.00%  apache
1          0.00%  curl/7.19.7 (i386-redhat-linux-gnu) libcurl/7.19.7 NSS/3.13.1.0 zlib/1.2.3 libidn/1.18 libssh2/1.2.2
1          0.00%  curl/7.19.7 (x86_64-unknown-linux-gnu) libcurl/7.19.7 NSS/3.12.7.0 zlib/1.2.3 libidn/1.18 libssh2/1.2.2
1          0.00%  curl/7.21.7 (i586-mandriva-linux-gnu) libcurl/7.21.7 OpenSSL/1.0.0d zlib/1.2.5 libidn/1.22 libssh2/1.2.9
1          0.00%  curl/7.49.1
1          0.00%  facebookexternalhit/1.1;line-poker/1.0
1          0.00%  iPXE/1.0.0+ (6d72b4)
1          0.00%  psbot/0.1 (+http://www.picsearch.com/bot.html)
1          0.00%  python-requests/2.8.1
1          0.00%  rpm/4.4.2.3
1          0.00%  urlgrabber/3.1.0 yum/3.2.19
1          0.00%  urlgrabber/3.9.1 yum/3.4.3
1          0.00%  viz/Nutch-1.7
1          0.00%  vu
1          0.00%  yacybot (/global; amd64 Linux 3.16.0-4-amd64; java 1.7.0_101; Europe/en) http://yacy.net/bot.html