Pages      User Agent
----------------  ----------------------

421422    16.39%  Browser: Netscape 4.8
10922      0.42%  Browser: Internet Explorer 5.0
6956       0.27%  Spider: Googlebot
3178       0.12%  Browser: Firefox
2819       0.11%  Browser: Safari (OSX)
1087       0.04%  Browser: Internet Explorer 5.21 (Mac)
627        0.02%  Browser: Internet Explorer 6.0 (Win)
242        0.01%  Browser: Internet Explorer 7.0 (Win)
225        0.01%  Browser: Internet Explorer 3.0  (win95)
45         0.00%  Browser: Netscape 4.5
16         0.00%  Browser: Netscape v3.xx
10         0.00%  Browser: Internet Explorer 5.5 (Win)
9          0.00%  Browser: Mozilla 1.x
8          0.00%  Browser: Opera
3          0.00%  Browser: Konqueror
2          0.00%  Browser: Internet Explorer 4.01
2          0.00%  Browser: Internet Explorer 4.5
1          0.00%  Browser: Netscape 8

733219    28.52%  Debian APT-HTTP/1.3 (1.0.1ubuntu2)
549606    21.38%  Debian APT-HTTP/1.3 (0.9.9.1~ubuntu1)
174756     6.80%  mirrormanager-crawler/0.1 (+http://fedorahosted.org/mirrormanager)
163827     6.37%  MirrorBrain Scanner/2.18.1 (See http://mirrorbrain.org/scanner_info)
124804     4.85%  Debian APT-HTTP/1.3 (1.0.9.8.3)
71515      2.78%  Debian APT-HTTP/1.3 (0.9.7.7ubuntu4)
63375      2.46%  Debian APT-HTTP/1.3 (1.0.9.8.2)
34256      1.33%  Debian APT-HTTP/1.3 (0.9.7.9)
30170      1.17%  Debian APT-HTTP/1.3 (1.0.10.2ubuntu1)
24755      0.96%  Debian APT-HTTP/1.3 (0.8.16~exp12ubuntu10.26)
23858      0.93%  urlgrabber/3.10 yum/3.4.3
21116      0.82%  MirrorBrain Probe (see http://mirrorbrain.org/probe_info)
19213      0.75%  Debian APT-HTTP/1.3 (1.0.9.7ubuntu4)
11358      0.44%  Debian APT-HTTP/1.3 (1.0.9.2ubuntu2)
6034       0.23%  Debian Apt-Cacher-NG/0.8.0
4820       0.19%  Debian APT-HTTP/1.3 (1.0.9.8.1)
4353       0.17%  curl/7.30.0
4248       0.17%  Debian APT-HTTP/1.3 (1.2.10)
3501       0.14%  Debian Apt-Cacher-NG/0.7.27
3167       0.12%  CentOSIPv6mirrorchecker/4.0; centos at miuku dot net
3013       0.12%  Debian APT-HTTP/1.3 (0.8.16~exp12ubuntu10.22)
2515       0.10%  Debian APT-HTTP/1.3 (0.8.16~exp12ubuntu10.16)
2385       0.09%  Debian APT-HTTP/1.3 (0.8.16~exp12ubuntu10.21)
1975       0.08%  libwww-perl/6.05
1739       0.07%  Debian APT-HTTP/1.3 (0.8.16~exp12ubuntu10.17)
1717       0.07%  Debian APT-HTTP/1.3 (0.8.16~exp12ubuntu10.25)
1405       0.05%  repoverge.net
1153       0.04%  Debian APT-HTTP/1.3 (0.8.16~exp12ubuntu10.15)
1069       0.04%  Wget/1.15 (linux-gnu)
927        0.04%  Wget/1.12 (linux-gnu)
861        0.03%  TurnitinBot (https://turnitin.com/robot/crawlerinfo.html)
734        0.03%  libwww-perl/6.15
606        0.02%  urlgrabber/3.9.1 yum/3.2.29
593        0.02%  Wotbox/2.01 (+http://www.wotbox.com/bot/)
591        0.02%  Debian APT-HTTP/1.3 (0.8.16~exp12ubuntu10.14)
554        0.02%  Debian APT-HTTP/1.3 (0.8.16~exp12ubuntu10.12)
487        0.02%  Aboundex/0.3 (http://www.aboundex.com/crawler/)
464        0.02%  Debian APT-HTTP/1.3 (0.8.16~exp12ubuntu10.24)
454        0.02%  Debian APT-HTTP/1.3 (1.2.9)
438        0.02%  Debian APT-HTTP/1.3 (0.8.10.3)
437        0.02%  Wget/1.13.4 (linux-gnu)
432        0.02%  HTTP-Tiny/0.033
415        0.02%  HTTP-Tiny/0.025
408        0.02%  Debian APT-HTTP/1.3 (0.8.16~exp12ubuntu10.23)
406        0.02%  Debian Apt-Cacher-NG/0.7.26
398        0.02%  apt-cacher/1.7.6 libcurl/7.26.0 GnuTLS/2.12.20 zlib/1.2.7 libidn/1.25 libssh2/1.4.2 librtmp/2.3
380        0.01%  Debian APT-HTTP/1.3 (0.8.16~exp12ubuntu10.19)
352        0.01%  Debian APT-HTTP/1.3 (1.0.9.10ubuntu1)
346        0.01%  Debian Apt-Cacher-NG/0.7.11
339        0.01%  Debian APT-HTTP/1.3 (1.0.9.8)
335        0.01%  CPAN::Mini/1.111008
263        0.01%  curl/7.21.7 (x86_64-mandriva-linux-gnu) libcurl/7.21.7 OpenSSL/1.0.0d zlib/1.2.5 libidn/1.22 libssh2/1.2.8
256        0.01%  Debian APT-HTTP/1.3 (0.8.16~exp12ubuntu10.7)
256        0.01%  Debian Apt-Cacher-NG/0.9.1
244        0.01%  Debian APT-HTTP/1.3 (1.2.6)
238        0.01%  curl/7.21.7 (i586-mandriva-linux-gnu) libcurl/7.21.7 OpenSSL/1.0.0d zlib/1.2.5 libidn/1.22 libssh2/1.2.9
232        0.01%  libwww-perl/6.04
224        0.01%  Debian APT-HTTP/1.3 (0.8.16~exp12ubuntu10)
218        0.01%  Debian APT-HTTP/1.3 (1.0.4ubuntu4)
213        0.01%  Wget/1.16 (linux-gnu)
206        0.01%  Artifactory/4.4.2
206        0.01%  libwww-perl/6.03
195        0.01%  curl/7.40.0
192        0.01%  Debian APT-HTTP/1.3 (1.2.7)
192        0.01%  lftp/4.0.9
188        0.01%  Ubuntu APT-HTTP/1.3 (0.7.25.3ubuntu9.17.1)
161        0.01%  curl/7.21.7 (x86_64-mandriva-linux-gnu) libcurl/7.21.7 OpenSSL/1.0.0d zlib/1.2.5 libidn/1.22 libssh2/1.2.9
141        0.01%  Debian APT-HTTP/1.3 (0.9.7.5ubuntu5)
129        0.01%  iPXE/1.0.0+ (d0bfd)
120        0.00%  Debian APT-HTTP/1.3 (0.8.16~exp12ubuntu10.10)
120        0.00%  Debian APT-HTTP/1.3 (0.9.7.5ubuntu5.1)
120        0.00%  libwww-perl/5.833
118        0.00%  Cloud mapping experiment. Contact research@pdrlabs.net
118        0.00%  semanticbot
103        0.00%  Mozilla/4.0 (compatible; MSIE 8.0; Windows NT 5.1; Trident/4.0)
96         0.00%  curl/7.20.1 (i586-mandriva-linux-gnu) libcurl/7.20.1 OpenSSL/1.0.0a zlib/1.2.3 libidn/1.18 libssh2/1.2.5
96         0.00%  libwww-perl/6.08
90         0.00%  Wget/1.10.2 (Red Hat modified)
89         0.00%  Links (2.9; FreeBSD 10.3-RELEASE amd64; LLVM/Clang 3.4.1; text)
88         0.00%  urlgrabber/3.1.0 yum/3.2.22
86         0.00%  BTWebClient/3460
72         0.00%  HTTP-Tiny/0.012
68         0.00%  Wget/1.11.4 Red Hat modified
61         0.00%  libwww-perl/5.837
60         0.00%  Debian APT-HTTP/1.3 (1.0.9.10+kali1~r2u1)
60         0.00%  Debian APT-HTTP/1.3 (1.1.10.1)
60         0.00%  curl/7.21.7 (i586-mandriva-linux-gnu) libcurl/7.21.7 OpenSSL/1.0.0d zlib/1.2.5 libidn/1.22 libssh2/1.2.8
59         0.00%  PycURL/7.29.0
57         0.00%  libwww-perl/6.13
53         0.00%  Python-urllib/2.6
51         0.00%  BB_Work_Connect/1.0.23246.28 CFNetwork/758.3.15 Darwin/15.4.0
46         0.00%  Java/1.6.0_04
46         0.00%  Java/1.8.0_77
46         0.00%  ltx71 - (http://ltx71.com/)
44         0.00%  Sogou web spider/4.0(+http://www.sogou.com/docs/help/webmasters.htm#07)
44         0.00%  urlgrabber/3.9.1
39         0.00%  Mozilla/4.0 (compatible;)
37         0.00%  Wget/1.14 (linux-gnu)
35         0.00%  iZSearch.com
34         0.00%  curl/7.19.6 (i586-mandriva-linux-gnu) libcurl/7.19.6 OpenSSL/0.9.8k zlib/1.2.3 libidn/1.15 libssh2/1.2.1
34         0.00%  mfibot/1.1 (http://www.mfisoft.ru/analyst/; 
33         0.00%  Mozilla/4.0
31         0.00%  urlgrabber/3.10
30         0.00%  Debian Apt-Cacher-NG/0.7.2
30         0.00%  HTTP-Tiny/0.017
29         0.00%  Xenu Link Sleuth/1.3.8
27         0.00%  ia_archiver
26         0.00%  Debian APT-HTTP/1.3 (1.2.3)
24         0.00%  Debian APT-HTTP/1.3 (1.0.1ubuntu2) BMID/E6802C255F
24         0.00%  curl/7.21.2 (i686-mandriva-linux-gnu) libcurl/7.21.2 OpenSSL/1.0.0a zlib/1.2.3 libidn/1.18 libssh2/1.2.5
23         0.00%  Debian APT-HTTP/1.3 (1.0.1ubuntu2.2)
23         0.00%  python-requests/2.6.0 CPython/2.7.5 Linux/3.10.0-327.13.1.el7.x86_64
21         0.00%  Debian APT-HTTP/1.3 (1.0.1ubuntu2) BMID/E6802C0D88
21         0.00%  Debian APT-HTTP/1.3 (1.0.1ubuntu2) BMID/E6802C15BA
20         0.00%  Wget/1.17.1 (linux-gnu)
18         0.00%  Debian APT-HTTP/1.3 (1.0.9.7ubuntu3)
17         0.00%  Go http package
15         0.00%  Debian APT-HTTP/1.3 (0.8.16~exp12ubuntu10.16aka1)
15         0.00%  Debian APT-HTTP/1.3 (0.8.3ubuntu7)
15         0.00%  Debian APT-HTTP/1.3 (1.0.1ubuntu2) BMID/E6802C11DE
14         0.00%  Debian APT-HTTP/1.3 (0.8.16~exp12ubuntu10.20.1)
12         0.00%  Debian APT-HTTP/1.3 (1.0.1ubuntu2) BMID/E6802BFE3B
12         0.00%  curl/7.29.0
12         0.00%  lftp/3.7.11
11         0.00%  Debian APT-HTTP/1.3 (1.2.11)
10         0.00%  BTWebClient/3450
10         0.00%  HTTP-Tiny/0.054
10         0.00%  YisouSpider
10         0.00%  ZmEu
9          0.00%  Debian APT-HTTP/1.3 (1.0.1ubuntu2) BMID/E675CC6A20
9          0.00%  Debian APT-HTTP/1.3 (1.0.1ubuntu2) BMID/E6802C1999
9          0.00%  Debian APT-HTTP/1.3 (1.0.1ubuntu2) BMID/E6802C1D4E
9          0.00%  Debian APT-HTTP/1.3 (1.0.1ubuntu2) BMID/E6802C24E5
9          0.00%  Lynx/2.8.8dev.12 libwww-FM/2.14 SSL-MM/1.4.1 GNUTLS/2.12.18
9          0.00%  curl/7.19.7 (x86_64-redhat-linux-gnu) libcurl/7.19.7 NSS/3.19.1 Basic ECC zlib/1.2.3 libidn/1.18 libssh2/1.4.2
9          0.00%  python-requests/2.9.1
9          0.00%  yacybot (/global; amd64 Linux 3.2.0-4-amd64; java 1.8.0_05; Europe/en) http://yacy.net/bot.html
8          0.00%  Go-http-client/1.1
8          0.00%  HTTP-Tiny/0.056
8          0.00%  PycURL/7.19.3 libcurl/7.37.1 GnuTLS/3.2.16 zlib/1.2.8 libidn/1.28 librtmp/2.3
8          0.00%  Wget(linux)
8          0.00%  vebidoobot
7          0.00%  HTTP-Tiny/0.043
7          0.00%  OrgProbe/0.9.4 (+http://www.blocked.org.uk)
6          0.00%  Debian APT-HTTP/1.3 (1.0.1ubuntu2) BMID/E6802BEE50
6          0.00%  Debian APT-HTTP/1.3 (1.0.1ubuntu2) BMID/E6802C15F2
6          0.00%  Debian APT-HTTP/1.3 (1.1.10)
6          0.00%  File::Fetch/0.48
6          0.00%  Mozilla/4.0 (compatible; Netcraft Web Server Survey)
6          0.00%  Python-urllib/2.4
6          0.00%  curl/7.20.1 (x86_64-mandriva-linux-gnu) libcurl/7.20.1 OpenSSL/1.0.0a zlib/1.2.3 libidn/1.18 libssh2/1.2.5
5          0.00%  Debian APT-HTTP/1.3 (0.8.13.2ubuntu4.6)
5          0.00%  Debian Apt-Cacher-NG/0.5.1
5          0.00%  Python-urllib/3.4
5          0.00%  Ubuntu APT-HTTP/1.3 (0.7.25.3ubuntu9.13)
5          0.00%  yacybot (/global; amd64 Linux 3.2.0-4-amd64; java 1.8.0_05; Europe/de) http://yacy.net/bot.html
4          0.00%  ) { :; }; /bin/bash -c 
4          0.00%  Debian APT-HTTP/1.3 (0.8.16~exp5ubuntu13.5)
4          0.00%  Debian APT-HTTP/1.3 (1.0.9.7)
4          0.00%  Spiderbot/Nutch-1.7
4          0.00%  Wget/1.15 (darwin13.2.0)
4          0.00%  curl/7.34.0
4          0.00%  libwww-perl/6.06
4          0.00%  masscan/1.0 (https://github.com/robertdavidgraham/masscan)
4          0.00%  python-requests/2.4.3 CPython/2.7.5 Linux/3.10.0-327.13.1.el7.x86_64
4          0.00%  www.probethenet.com scanner
3          0.00%  Lynx/2.8.6rel.5 libwww-FM/2.14 SSL-MM/1.4.1 OpenSSL/1.0.0-fips
3          0.00%  Mozilla/4.0 (compatible; MSIE 9.0; Windows NT 6.1)
3          0.00%  Mozilla/4.0 (compatible; Synapse)
3          0.00%  StatsInfo
3          0.00%  Telesphoreo
3          0.00%  curl/7.48.0
3          0.00%  facebookexternalhit/1.1
2          0.00%  BOT/0.1 (BOT for JCE)
2          0.00%  CakePHP
2          0.00%  Chef Knife/12.4.3 (ruby-2.1.6-p336; ohai-8.5.1; x86_64-linux; +http://opscode.com)
2          0.00%  Debian APT-HTTP/1.3 (0.8.3ubuntu7.1)
2          0.00%  ELinks/0.12pre6 (textmode; Linux; 160x48-2)
2          0.00%  HTMLGET 1.0
2          0.00%  PycURL/7.19.3 libcurl/7.38.0 GnuTLS/3.2.16 zlib/1.2.8 libidn/1.28 librtmp/2.3
2          0.00%  Research scan, mail networkresearch@yandex.ru
2          0.00%  Ruby
2          0.00%  Ubuntu APT-HTTP/1.3 (0.7.25.3ubuntu9.10)
2          0.00%  WhatWeb/0.4.8-dev
2          0.00%  curl/7.19.7 (x86_64-redhat-linux-gnu) libcurl/7.19.7 NSS/3.15.3 zlib/1.2.3 libidn/1.18 libssh2/1.4.2
2          0.00%  iPXE/1.0.0+ (6d72b4)
2          0.00%  libwww-perl/5.805
2          0.00%  nutch-1.4/Nutch-1.4
2          0.00%  yacybot (/global; amd64 Windows 10 10.0; java 1.8.0_77; Europe/fr) http://yacy.net/bot.html
1          0.00%  17
1          0.00%  Apache-HttpAsyncClient/4.1.1 (Java/1.8.0_91)
1          0.00%  Burnbit Worker
1          0.00%  CCBot/2.0 (http://commoncrawl.org/faq/)
1          0.00%  CentOS (anaconda)/7 yum/3.4.3
1          0.00%  Chef Client/11.18.12 (ruby-1.9.3-p550; ohai-7.4.1; x86_64-linux; +http://opscode.com)
1          0.00%  Curl/PHP 5.4.45 (http://github.com/shuber/curl)
1          0.00%  DAP 10
1          0.00%  Debian APT-HTTP/1.3 (0.8.0ubuntu2)
1          0.00%  Lynx/2.8.8dev.15 libwww-FM/2.14 SSL-MM/1.4.1 OpenSSL/1.0.1e-fips
1          0.00%  Mojolicious (Perl)
1          0.00%  Mozilla/4.0 (CMS Crawler: http://www.cmscrawler.com)
1          0.00%  Mozilla/4.0 (compatible  MSIE 8.0  Windows NT 5.1  Trident/4.0  GTB6.6  MRSPUTNIK 2, 4, 0, 201  MRA 5.7 (build 03796)  InfoPath.2  .NET CLR 1.1.4322)
1          0.00%  Mozilla/4.0 (compatible  MSIE 8.0  Windows NT 5.1  Trident/4.0  User-agent: Mozilla/4.0 (compatible  MSIE 6.0  Windows NT 5.1  SV1  http://bsalsa.com)   InfoPath.2)
1          0.00%  Mozilla/4.0 (compatible; MSIE 8.0; Windows NT 6.0; Trident/4.0)
1          0.00%  Mozilla/4.0 (compatible; MSIE 8.0; Windows NT 6.1; Trident/4.0)
1          0.00%  Mozilla/4.0 (compatible; Win32; WinHttp.WinHttpRequest.5)
1          0.00%  Nokia2700c-2/2.0 (07.80) Profile/MIDP-2.1 Configuration/CLDC-1.1 nokia2700c-2/UC Browser7.7.1.88/69/444 UNTRUSTED/1.0
1          0.00%  PagesInventory (robot +http://www.pagesinventory.com)
1          0.00%  Python-urllib/2.7
1          0.00%  SafeDNSBot (https://www.safedns.com/searchbot)
1          0.00%  Slackbot-LinkExpanding 1.0 (+https://api.slack.com/robots)
1          0.00%  WWW-Mechanize/1.73
1          0.00%  WordPress.com; https://jmmiddleware.wordpress.com
1          0.00%  curl/7.19.7 (i386-redhat-linux-gnu) libcurl/7.19.7 NSS/3.19.1 Basic ECC zlib/1.2.3 libidn/1.18 libssh2/1.4.2
1          0.00%  curl/7.19.7 (i686-pc-linux-gnu) libcurl/7.19.7 NSS/3.12.7.0 zlib/1.2.3 libidn/1.18 libssh2/1.2.2
1          0.00%  curl/7.19.7 (x86_64-redhat-linux-gnu) libcurl/7.19.7 NSS/3.13.1.0 zlib/1.2.3 libidn/1.18 libssh2/1.2.2
1          0.00%  curl/7.19.7 (x86_64-unknown-linux-gnu) libcurl/7.19.7 NSS/3.12.7.0 zlib/1.2.3 libidn/1.18 libssh2/1.2.2
1          0.00%  curl/7.21.7 (i586-mandriva-linux-gnu) libcurl/7.21.7 OpenSSL/1.0.2a zlib/1.2.5 libidn/1.22 libssh2/1.2.9
1          0.00%  curl/7.22.0 (x86_64-pc-linux-gnu) libcurl/7.22.0 OpenSSL/1.0.1 zlib/1.2.3.4 libidn/1.23 librtmp/2.3
1          0.00%  curl/7.38.0
1          0.00%  facebookexternalhit/1.1 (+http://www.facebook.com/externalhit_uatext.php)
1          0.00%  libwww-perl/6.07
1          0.00%  safe-agent-scanner
1          0.00%  smart/1.4
1          0.00%  spiderman
1          0.00%  the beast