Pages      User Agent
----------------  ----------------------

376262    17.50%  Browser: Netscape 4.8
34266      1.59%  Browser: Internet Explorer 3.0  (win95)
4931       0.23%  Browser: Internet Explorer 5.0
4665       0.22%  Spider: Googlebot
3436       0.16%  Browser: Internet Explorer 6.0 (Win)
3265       0.15%  Browser: Safari (OSX)
2906       0.14%  Browser: Firefox
950        0.04%  Browser: Internet Explorer 5.21 (Mac)
67         0.00%  Browser: Internet Explorer 7.0 (Win)
58         0.00%  Browser: Opera
5          0.00%  Browser: Internet Explorer 5.5 (Win)
4          0.00%  Browser: Netscape v3.xx
1          0.00%  Browser: Konqueror
1          0.00%  Browser: Mozilla 1.x

601072    27.95%  MirrorBrain Scanner/2.18.1 (See http://mirrorbrain.org/scanner_info)
360868    16.78%  Debian APT-HTTP/1.3 (1.0.1ubuntu2)
211533     9.84%  mirrormanager-crawler/0.1 (+http://fedorahosted.org/mirrormanager)
138525     6.44%  Debian APT-HTTP/1.3 (0.9.9.1~ubuntu1)
73274      3.41%  Debian APT-HTTP/1.3 (1.0.9.8.3)
44431      2.07%  urlgrabber/3.10 yum/3.4.3
42827      1.99%  MirrorBrain Probe (see http://mirrorbrain.org/probe_info)
41578      1.93%  Debian APT-HTTP/1.3 (1.2.15)
26139      1.22%  Debian APT-HTTP/1.3 (1.0.9.8.4)
24692      1.15%  Debian APT-HTTP/1.3 (0.9.7.9)
18158      0.84%  Debian APT-HTTP/1.3 (1.0.9.7ubuntu4)
15794      0.73%  Debian APT-HTTP/1.3 (0.9.7.7ubuntu4)
10107      0.47%  Debian Apt-Cacher-NG/0.8.0
10023      0.47%  Debian APT-HTTP/1.3 (0.8.16~exp12ubuntu10.27)
10016      0.47%  Debian APT-HTTP/1.3 (1.0.10.2ubuntu1)
9816       0.46%  Debian APT-HTTP/1.3 (0.8.16~exp12ubuntu10.26)
8971       0.42%  Debian APT-HTTP/1.3 (1.2.12)
8811       0.41%  Debian APT-HTTP/1.3 (1.0.9.8.2)
6075       0.28%  Debian Apt-Cacher-NG/0.7.27
3440       0.16%  CentOSIPv6mirrorchecker/4.0; centos at miuku dot net
3267       0.15%  Debian APT-HTTP/1.3 (1.0.9.2ubuntu2)
3162       0.15%  curl/7.30.0
2207       0.10%  Debian APT-HTTP/1.3 (0.8.16~exp12ubuntu10.21)
1953       0.09%  Wget/1.12 (linux-gnu)
1851       0.09%  Debian APT-HTTP/1.3 (0.8.16~exp12ubuntu10.25)
1845       0.09%  Debian APT-HTTP/1.3 (0.8.10.3)
1494       0.07%  Debian APT-HTTP/1.3 (0.8.16~exp12ubuntu10.17)
1457       0.07%  repoverge.net
1415       0.07%  Debian APT-HTTP/1.3 (1.2.10)
1057       0.05%  Debian APT-HTTP/1.3 (0.8.16~exp12ubuntu10.22)
1021       0.05%  libwww-perl/6.05
985        0.05%  Debian APT-HTTP/1.3 (0.8.16~exp12ubuntu10.16)
911        0.04%  Wget/1.13.4 (linux-gnu)
900        0.04%  Debian APT-HTTP/1.3 (1.0.9.8)
806        0.04%  Wget/1.15 (linux-gnu)
662        0.03%  apt-cacher/1.7.6 libcurl/7.26.0 GnuTLS/2.12.20 zlib/1.2.7 libidn/1.25 libssh2/1.4.2 librtmp/2.3
634        0.03%  urlgrabber/3.9.1 yum/3.2.29
608        0.03%  Debian APT-HTTP/1.3 (0.8.16~exp12ubuntu10.14)
589        0.03%  Debian APT-HTTP/1.3 (0.8.16~exp12ubuntu10.15)
576        0.03%  Debian APT-HTTP/1.3 (1.2.17)
535        0.02%  Debian APT-HTTP/1.3 (0.8.16~exp12ubuntu10.12)
526        0.02%  Debian APT-HTTP/1.3 (1.3.1)
438        0.02%  iPXE/1.0.0+ (d0bfd)
436        0.02%  TurnitinBot (https://turnitin.com/robot/crawlerinfo.html)
393        0.02%  Debian APT-HTTP/1.3 (0.8.16~exp12ubuntu10.24)
377        0.02%  lftp/4.4.8
370        0.02%  Blackboard Safeassign/0.1 (a Storm-based Blackboard Safeassign web-crawler; https://github.com/DigitalPebble/storm-crawler; stormcrawler@digitalpebble.com)
362        0.02%  HTTP-Tiny/0.033
335        0.02%  Debian Apt-Cacher-NG/0.7.26
312        0.01%  PycURL/7.19.7
310        0.01%  Lynx/2.8.8dev.12 libwww-FM/2.14 SSL-MM/1.4.1 GNUTLS/2.12.18
277        0.01%  libwww-perl/6.04
270        0.01%  libwww-perl/6.15
265        0.01%  Debian APT-HTTP/1.3 (1.2.14)
248        0.01%  Debian APT-HTTP/1.3 (0.8.16~exp12ubuntu10.23)
246        0.01%  curl/7.21.7 (x86_64-mandriva-linux-gnu) libcurl/7.21.7 OpenSSL/1.0.0d zlib/1.2.5 libidn/1.22 libssh2/1.2.8
216        0.01%  libwww-perl/6.03
211        0.01%  Wget/1.17.1 (linux-gnu)
208        0.01%  Debian Apt-Cacher-NG/0.9.1
207        0.01%  curl/7.19.6 (i586-mandriva-linux-gnu) libcurl/7.19.6 OpenSSL/0.9.8k zlib/1.2.3 libidn/1.15 libssh2/1.2.1
186        0.01%  Debian APT-HTTP/1.3 (1.3.3)
182        0.01%  Wget/1.16 (linux-gnu)
163        0.01%  HTTP-Tiny/0.012
145        0.01%  Lynx/2.8.8dev.12 libwww-FM/2.14 SSL-MM/1.4.1 GNUTLS/2.12.20
144        0.01%  Debian APT-HTTP/1.3 (0.8.16~exp12ubuntu10)
143        0.01%  Python-urllib/2.7
135        0.01%  Artifactory/4.9.0
124        0.01%  Debian Apt-Cacher-NG/0.7.11
124        0.01%  apt-cacher/1.7.11 libcurl/7.47.0 GnuTLS/3.4.10 zlib/1.2.8 libidn/1.32 librtmp/2.3
124        0.01%  ltx71 - (http://ltx71.com/)
122        0.01%  curl/7.20.1 (i586-mandriva-linux-gnu) libcurl/7.20.1 OpenSSL/1.0.0a zlib/1.2.3 libidn/1.18 libssh2/1.2.5
118        0.01%  Debian APT-HTTP/1.3 (1.4~beta2)
108        0.01%  Cloud mapping experiment. Contact research@pdrlabs.net
107        0.00%  HTTP-Tiny/0.025
102        0.00%  Wget/1.18 (linux-gnu)
98         0.00%  Debian APT-HTTP/1.3 (0.8.16~exp5ubuntu13.1)
96         0.00%  Debian APT-HTTP/1.3 (0.8.13.2ubuntu4.6)
86         0.00%  urlgrabber/3.1.0 yum/3.2.22
80         0.00%  libwww-perl/6.08
73         0.00%  Artifactory/4.14.2
68         0.00%  GigablastOpenSource/1.0
65         0.00%  libwww-perl/5.837
64         0.00%  Mozilla/4.0 (compatible; MSIE 8.0; Windows NT 5.1; Trident/4.0)
62         0.00%  python-requests/2.6.0 CPython/2.7.5 Linux/3.10.0-327.28.3.el7.x86_64
61         0.00%  Sogou web spider/4.0(+http://www.sogou.com/docs/help/webmasters.htm#07)
58         0.00%  Debian APT-HTTP/1.3 (1.0.9.8.1)
58         0.00%  apt-cacher/1.6.12 libcurl/7.21.0 GnuTLS/2.8.6 zlib/1.2.3.4 libidn/1.15
52         0.00%  Debian APT-HTTP/1.3 (1.3.2)
50         0.00%  urlgrabber/3.10
48         0.00%  HTTP-Tiny/0.054
44         0.00%  Debian APT-HTTP/1.3 (1.4~beta1)
44         0.00%  curl/7.40.0
39         0.00%  urlgrabber/3.9.1
37         0.00%  curl/7.21.7 (x86_64-mandriva-linux-gnu) libcurl/7.21.7 OpenSSL/1.0.0d zlib/1.2.5 libidn/1.22 libssh2/1.2.9
36         0.00%  PycURL/7.29.0
36         0.00%  python-requests/2.6.0 CPython/2.7.5 Linux/3.10.0-514.2.2.el7.x86_64
35         0.00%  HTTP-Tiny/0.056
35         0.00%  libwww-perl/5.805
32         0.00%  vebidoobot
30         0.00%  HTTP-Tiny/0.017
30         0.00%  Wget(linux)
26         0.00%  WordPress/4.7; http://www.qjdaiwei.com
26         0.00%  libwww-perl/6.13
26         0.00%  python-requests/2.6.0 CPython/2.7.5 Linux/3.10.0-327.36.3.el7.x86_64
25         0.00%  Go-http-client/1.1
24         0.00%  Debian APT-HTTP/1.3 (1.2.18)
24         0.00%  Python-urllib/2.6
22         0.00%  BTWebClient/3490
21         0.00%  Wget/1.14 (linux-gnu)
17         0.00%  HTTP-Tiny/0.070
17         0.00%  python-requests/2.4.3 CPython/2.7.5 Linux/3.10.0-514.2.2.el7.x86_64
16         0.00%  curl/7.19.7 (x86_64-redhat-linux-gnu) libcurl/7.19.7 NSS/3.19.1 Basic ECC zlib/1.2.3 libidn/1.18 libssh2/1.4.2
15         0.00%  Mozilla/4.0 (compatible;)
14         0.00%  lftp/4.0.9
14         0.00%  python-requests/2.4.3 CPython/2.7.5 Linux/3.10.0-327.36.3.el7.x86_64
13         0.00%  curl/7.21.7 (i586-mandriva-linux-gnu) libcurl/7.21.7 OpenSSL/1.0.0d zlib/1.2.5 libidn/1.22 libssh2/1.2.8
13         0.00%  curl/7.37.0
12         0.00%  SEMrushBot
12         0.00%  curl/7.19.7 (x86_64-redhat-linux-gnu) libcurl/7.19.7 NSS/3.21 Basic ECC zlib/1.2.3 libidn/1.18 libssh2/1.4.2
12         0.00%  ia_archiver
11         0.00%  larbin_2.6.3 larbin2.6.3@unspecified.mail
10         0.00%  Debian APT-HTTP/1.3 (0.8.3ubuntu7.3)
10         0.00%  Mozilla/4.0 (compatible; MSIE 8.0; Windows NT 5.1; Trident/4.0; .NET CLR 2.0.50727)
10         0.00%  curl/7.21.2 (i686-mandriva-linux-gnu) libcurl/7.21.2 OpenSSL/1.0.0a zlib/1.2.3 libidn/1.18 libssh2/1.2.5
9          0.00%  Debian APT-HTTP/1.3 (1.0.1ubuntu2) BMID/E675CCB084
9          0.00%  WordPress/4.7; https://holywhite.com
8          0.00%  curl/7.20.1 (x86_64-mandriva-linux-gnu) libcurl/7.20.1 OpenSSL/1.0.0a zlib/1.2.3 libidn/1.18 libssh2/1.2.5
7          0.00%  BTWebClient/346B(41079)
7          0.00%  CentOS (anaconda)/7 yum/3.4.3
7          0.00%  HELLO Crawler
7          0.00%  Mozilla/4.0 (compatible; Synapse)
7          0.00%  PycURL/7.19.3 libcurl/7.37.1 GnuTLS/3.2.16 zlib/1.2.8 libidn/1.28 librtmp/2.3
7          0.00%  curl/7.29.0
6          0.00%  Debian APT-HTTP/1.3 (1.0.1ubuntu2) BMID/E675CC2F94
6          0.00%  Debian APT-HTTP/1.3 (1.0.1ubuntu2) BMID/E6802C05C2
6          0.00%  Google-HTTP-Java-Client/1.17.0-rc (gzip)
6          0.00%  Mozilla/4.0 (compatible; Netcraft Web Server Survey)
6          0.00%  OrgProbe/0.9.4 (+http://www.blocked.org.uk)
6          0.00%  curl/7.47.0
6          0.00%  libwww-perl/5.803
6          0.00%  masscan/1.0 (https://github.com/robertdavidgraham/masscan)
5          0.00%  CCBot/2.0 (http://commoncrawl.org/faq/)
5          0.00%  Googleboot
5          0.00%  Java/1.7.0_80
5          0.00%  Mozilla/4.0 (compatible; MSIE 8.0; Windows NT 6.1; Trident/4.0)
5          0.00%  YisouSpider
5          0.00%  curl/7.19.0 (i586-mandriva-linux-gnu) libcurl/7.19.0 OpenSSL/0.9.8h zlib/1.2.3 libidn/1.10 libssh2/0.18
5          0.00%  curl/7.49.1
5          0.00%  python-requests/2.6.0 CPython/2.7.5 Linux/3.10.0-327.36.2.el7.x86_64
5          0.00%  python-requests/2.6.0 CPython/2.7.5 Linux/3.10.0-514.el7.x86_64
4          0.00%  Blackboard Safeassign
4          0.00%  Debian APT-HTTP/1.3 (0.9.12.1)
4          0.00%  Debian APT-HTTP/1.3 (1.3~rc2)
4          0.00%  Telesphoreo
4          0.00%  WordPress/4.7; https://blog.linglong.biz
4          0.00%  Xenu Link Sleuth/1.3.8
4          0.00%  ZmEu
4          0.00%  curl/7.17.1 (mips-unknown-linux-gnu) libcurl/7.17.1 OpenSSL/0.9.8i zlib/1.2.3
3          0.00%  AppEngine-Google; (+http://code.google.com/appengine; appid: s~malkman36)
3          0.00%  BigDataCloud
3          0.00%  BoogleBot/2.0
3          0.00%  HTTP-Tiny/0.043
3          0.00%  Java/1.6.0_22
3          0.00%  Mozilla/4.0 (compatible; MSIE 8.0; Windows NT 5.1; Trident/4.0; GTB6; Acoo Browser; .NET CLR 1.1.4322; .NET CLR 2.0.50727)
3          0.00%  Mozilla/4.0 (compatible; MSIE 8.0; Windows NT 6.1)
3          0.00%  Mozilla/4.0 (compatible; MSIE 9.0; Windows NT 6.1)
3          0.00%  PycURL/7.19.3 libcurl/7.51.0 GnuTLS/3.2.11 zlib/1.2.8 libssh2/1.4.3 nghttp2/1.14.1 librtmp/2.3
3          0.00%  Riddler (http://riddler.io/about)
3          0.00%  censys.io internet census
3          0.00%  curl/7.19.7 (i386-redhat-linux-gnu) libcurl/7.19.7 NSS/3.21 Basic ECC zlib/1.2.3 libidn/1.18 libssh2/1.4.2
3          0.00%  curl/7.51.0
3          0.00%  facebookexternalhit/1.1 (+http://www.facebook.com/externalhit_uatext.php)
2          0.00%  ) { :;}; /bin/bash -c 
2          0.00%  ) { :;};echo; /bin/bash -c 
2          0.00%  CakePHP
2          0.00%  Debian APT-HTTP/1.3 (1.3)
2          0.00%  HTTP-Tiny/0.034
2          0.00%  Iframely/0.8.5 (+http://iframely.com/;)
2          0.00%  Mozilla
2          0.00%  NetSurf/3.6 (Linux; Arch Linux)
2          0.00%  Seeker v.1 http://LookSeek.com/seeker/
2          0.00%  Twitterbot/1.0
2          0.00%  Ubuntu APT-HTTP/1.3 (0.7.23.1ubuntu2)
2          0.00%  Ubuntu APT-HTTP/1.3 (0.7.25.3ubuntu9.17.1)
2          0.00%  Ubuntu APT-HTTP/1.3 (0.7.25.3ubuntu9.5)
2          0.00%  libwww-perl/6.06
2          0.00%  nutch-1.4/Nutch-1.4
2          0.00%  python-requests/2.7.0 CPython/2.7.9 Windows/2003Server
2          0.00%  www.probethenet.com scanner
1          0.00%  33c3
1          0.00%  Artifactory/4.4.3
1          0.00%  CentOS Linux (anaconda)/7 yum/3.4.3
1          0.00%  Cloud mapping experiment searching for shoutcast servers. Contact research@pdrlabs.net
1          0.00%  Debian APT-HTTP/1.3 (1.2.11)
1          0.00%  Experibot_v1 [bit.ly/2bLMJdw]
1          0.00%  Favicon downloader (+https://favico.be/bot.html)
1          0.00%  Links (2.8; Linux 3.16.0-4-amd64 x86_64; GNU C 4.9.1; x)
1          0.00%  Microsoft Office Word 2014
1          0.00%  Microsoft Windows Network Diagnostics
1          0.00%  Mozilla (+http://web.nli.org.il/sites/NLI/English/collections/israel-collection/internet_archive/Pages/default.aspx)
1          0.00%  Mozilla/4.0 (compatible;  Vagabondo/4.0; http://webagent.wise-guys.nl/; http://www.wise-guys.nl/)
1          0.00%  Mozilla/4.0 (compatible; MSIE 8.0; Windows NT 5.1; Trident/4.0; GTB7.4)
1          0.00%  PycURL/7.19.3 libcurl/7.38.0 GnuTLS/3.2.16 zlib/1.2.8 libidn/1.28 librtmp/2.3
1          0.00%  PycURL/7.19.3 libcurl/7.47.0 GnuTLS/3.2.11 zlib/1.2.8 libidn/1.28 librtmp/2.3
1          0.00%  PycURL/7.19.5 libcurl/7.38.0 GnuTLS/3.3.8 zlib/1.2.8 libidn/1.29 libssh2/1.4.3 librtmp/2.3
1          0.00%  PycURL/7.26.0
1          0.00%  RobotsChecker/0.6 (+http://www.blocked.org.uk)
1          0.00%  Scanbot
1          0.00%  Slackbot-LinkExpanding 1.0 (+https://api.slack.com/robots)
1          0.00%  UCWEB/2.0 (Windows; U; wds 8.10; cs-CZ; NOKIA; RM-994_eu_hungary_1156) U2/1.0.0 UCBrowser/4.2.1.541 U2/1.0.0 Mobile
1          0.00%  Ubuntu APT-HTTP/1.3 (0.7.25.3ubuntu9.6)
1          0.00%  curl/7.19.7 (x86_64-redhat-linux-gnu) libcurl/7.19.7 NSS/3.15.3 zlib/1.2.3 libidn/1.18 libssh2/1.4.2
1          0.00%  facebookexternalhit/1.1
1          0.00%  http://seriyps.ru/blog/2009/09/23/svn-xak-pishu-grabber/
1          0.00%  iPXE/1.0.0+ (26050)
1          0.00%  iPXE/1.0.0+ (86285)
1          0.00%  kscan1.4.3
1          0.00%  python-requests/2.6.0 CPython/2.6.6 Linux/2.6.32-573.12.1.el6.x86_64
1          0.00%  server-bag [iPhone OS,10.1.1,14B100,iPhone9,1]
1          0.00%  yacybot (-global; amd64 Linux 4.4.0-57-generic; java 9-internal; Europe/en) http://yacy.net/bot.html
1          0.00%  yacybot (/global; amd64 Linux 4.4.0-57-generic; java 1.8.0_111; Europe/de) http://yacy.net/bot.html