Summary Period: September 2017 - User Agent
Generated 01-Oct-2017 00:01 BST
Pages User Agent ---------------- ---------------------- 403948 21.56% Browser: Netscape 4.8 11027 0.59% Browser: Internet Explorer 3.0 (win95) 7194 0.38% Browser: Safari (OSX) 4334 0.23% Spider: Googlebot 3965 0.21% Browser: Internet Explorer 5.0 2853 0.15% Browser: Internet Explorer 6.0 (Win) 2737 0.15% Browser: Firefox 1207 0.06% Browser: Internet Explorer 5.21 (Mac) 200 0.01% Browser: Internet Explorer 7.0 (Win) 6 0.00% Browser: Opera 5 0.00% Browser: Netscape v3.xx 3 0.00% Browser: Netscape 4.5 2 0.00% Browser: Netscape 4.6 (Mac/WinNT) 1 0.00% Browser: Internet Explorer 5.5 (Win) 1 0.00% Browser: Konqueror 1 0.00% Browser: Mozilla 1.x 1 0.00% Browser: Netscape v1.xx 1 0.00% Browser: Netscape v2.xx 1 0.00% Spider: MSNBot 272898 14.57% MirrorBrain Scanner/2.18.1 (See http://mirrorbrain.org/scanner_info) 260925 13.93% Debian APT-HTTP/1.3 (0.9.9.1~ubuntu1) 229694 12.26% Debian APT-HTTP/1.3 (1.0.1ubuntu2) 228927 12.22% mirrormanager-crawler/0.1 (+http://fedorahosted.org/mirrormanager) 87709 4.68% Debian APT-HTTP/1.3 (1.0.9.8.4) 68793 3.67% urlgrabber/3.10 yum/3.4.3 55554 2.97% Debian APT-HTTP/1.3 (1.2.24) 19106 1.02% Debian APT-HTTP/1.3 (0.9.7.9) 18536 0.99% Debian APT-HTTP/1.3 (1.2.20) 12631 0.67% Debian Apt-Cacher-NG/0.8.0 11991 0.64% Debian APT-HTTP/1.3 (1.0.9.8.3) 11106 0.59% Debian APT-HTTP/1.3 (1.0.9.7ubuntu4) 10564 0.56% Debian APT-HTTP/1.3 (1.4.7) 8446 0.45% MirrorBrain Probe (see http://mirrorbrain.org/probe_info) 8366 0.45% Debian APT-HTTP/1.3 (1.0.10.2ubuntu1) 7941 0.42% Debian APT-HTTP/1.3 (1.0.9.8.2) 7770 0.41% Debian APT-HTTP/1.3 (0.8.16~exp12ubuntu10.27) 6991 0.37% curl/7.29.0 6506 0.35% Debian APT-HTTP/1.3 (1.2.19) 5333 0.28% Debian Apt-Cacher-NG/0.9.1 4475 0.24% CentOSIPv6mirrorchecker/4.0; centos at miuku dot net 4161 0.22% Debian APT-HTTP/1.3 (1.0.9.8.1) 4044 0.22% HTTP-Tiny/0.056 3870 0.21% Debian APT-HTTP/1.3 (1.2.15) 3842 0.21% Wget/1.17.1 (linux-gnu) 3487 0.19% curl/7.30.0 3114 0.17% HTTP-Tiny/0.033 2843 0.15% Debian APT-HTTP/1.3 (1.3~pre2) 2556 0.14% Debian APT-HTTP/1.3 (1.4.6) 2462 0.13% Debian APT-HTTP/1.3 (1.0.9.2ubuntu2) 2313 0.12% Debian APT-HTTP/1.3 (1.4) 2207 0.12% Debian APT-HTTP/1.3 (1.2.12) 2014 0.11% Debian APT-HTTP/1.3 (0.8.16~exp12ubuntu10.26) 1978 0.11% Debian APT-HTTP/1.3 (0.8.16~exp12ubuntu10.21) 1795 0.10% libwww-perl/6.05 1428 0.08% Debian APT-HTTP/1.3 (0.8.10.3) 1409 0.08% repoverge.net 1329 0.07% Debian APT-HTTP/1.3 (0.8.16~exp12ubuntu10.25) 1228 0.07% Debian APT-HTTP/1.3 (0.8.16~exp12ubuntu10.17) 1203 0.06% Wget/1.12 (linux-gnu) 1115 0.06% Debian APT-HTTP/1.3 (0.8.16~exp12ubuntu10.22) 1103 0.06% Barkrowler experimental crawler - 0.4.7 1087 0.06% Cloud mapping experiment. Contact research@pdrlabs.net 861 0.05% HTTPing v2.6 810 0.04% Debian APT-HTTP/1.3 (0.8.16~exp12ubuntu10.16) 807 0.04% HTTP-Tiny/0.070 779 0.04% HTTP-Tiny/0.058 755 0.04% Debian APT-HTTP/1.3 (1.2.18) 712 0.04% Wget/1.15 (linux-gnu) 644 0.03% urlgrabber/3.9.1 yum/3.2.29 643 0.03% Debian Apt-Cacher-NG/2 560 0.03% mirrormanager-crawler/0.1 (+https://github.com/fedora-infra/mirrormanager2/) 495 0.03% Wget/1.13.4 (linux-gnu) 471 0.03% Debian APT-HTTP/1.3 (0.8.16~exp12ubuntu10.14) 454 0.02% apt-cacher/1.7.6 libcurl/7.26.0 GnuTLS/2.12.20 zlib/1.2.7 libidn/1.25 libssh2/1.4.2 librtmp/2.3 363 0.02% libwww-perl/6.26 361 0.02% Debian Apt-Cacher-NG/0.7.26 360 0.02% Debian APT-HTTP/1.3 (0.8.16~exp12ubuntu10.12) 353 0.02% Debian APT-HTTP/1.3 (0.9.7.7ubuntu4) 341 0.02% lftp/4.4.8 337 0.02% HTTP-Tiny/0.025 334 0.02% Wget/1.14 (linux-gnu) 322 0.02% Debian APT-HTTP/1.3 (0.8.16~exp12ubuntu10.24) 317 0.02% Debian APT-HTTP/1.3 (1.3.5) 315 0.02% PycURL/7.19.7 309 0.02% Mozilla/4.0 293 0.02% apt-cacher/1.7.6+deb7u1 libcurl/7.26.0 GnuTLS/2.12.20 zlib/1.2.7 libidn/1.25 libssh2/1.4.2 librtmp/2.3 287 0.02% CCBot/2.0 (http://commoncrawl.org/faq/) 269 0.01% Debian APT-HTTP/1.3 (1.2.10) 240 0.01% Debian APT-HTTP/1.3 (0.8.16~exp12ubuntu10.23) 236 0.01% curl/7.19.6 (i586-mandriva-linux-gnu) libcurl/7.19.6 OpenSSL/0.9.8k zlib/1.2.3 libidn/1.15 libssh2/1.2.1 230 0.01% libwww-perl/6.15 221 0.01% DigitalPebble Crawler/1.6-SNAPSHOT (StormCrawler Benchmark; http://digitalpebble.com/; crawler@digitalpebble.com) 221 0.01% Lynx/2.8.8dev.12 libwww-FM/2.14 SSL-MM/1.4.1 GNUTLS/2.12.20 210 0.01% Vegi bot (we follow your robots.txt settings before crawling, you can slow down the bot by change the Crawl-Delay parameter in the settings.if you have an enquiry, please email to: abuse-report@terrykyleseoagency.com) 208 0.01% Debian APT-HTTP/1.3 (1.5~rc1~ubuntu1) 208 0.01% python-requests/2.6.0 CPython/2.7.5 Linux/3.10.0-514.26.1.el7.x86_64 178 0.01% Wget/1.16 (linux-gnu) 176 0.01% Java/1.6.0_04 174 0.01% HTTP-Tiny/0.016 172 0.01% Java/1.8.0_40 167 0.01% ltx71 - (http://ltx71.com/) 166 0.01% Debian APT-HTTP/1.3 (1.5~beta1) 140 0.01% Debian APT-HTTP/1.3 (1.2.15+2) 130 0.01% Mozilla/4.0 (compatible; MSIE 8.0; Windows NT 5.1; Trident/4.0) 126 0.01% Debian APT-HTTP/1.3 (0.8.16~exp12ubuntu10) 120 0.01% Debian APT-HTTP/1.3 (1.5~rc4) 112 0.01% Debian Apt-Cacher-NG/0.7.11 108 0.01% python-requests/2.6.0 CPython/2.7.5 Linux/3.10.0-514.26.2.el7.x86_64 104 0.01% Debian APT-HTTP/1.3 (0.8.16~exp12ubuntu10.15) 102 0.01% Mozilla/4.0 (compatible; MSIE 9.0; Windows NT 6.1) 100 0.01% Debian APT-HTTP/1.3 (1.2.17) 96 0.01% DigitalPebble Crawler/1.4-SNAPSHOT (StormCrawler Benchmark; http://digitalpebble.com/; crawler@digitalpebble.com) 92 0.00% HTTP-Tiny/0.064 78 0.00% ostree 74 0.00% HTTP-Tiny/0.012 73 0.00% ostree libsoup/2.58.2 71 0.00% Barkrowler/0.4.8 (experimenting / debugging - sorry for your logs ) www.exensa.com/crawl - admin@exensa.com -- based on BUBing 66 0.00% TurnKey APT-HTTP/1.3 (turnkey-nginx-php-fastcgi-14.2-jessie-amd64 vm) 65 0.00% Debian APT-HTTP/1.3 (0.9.15.4ubuntu1) 60 0.00% python-requests/2.6.0 CPython/2.7.5 Linux/3.10.0-327.28.3.el7.x86_64 58 0.00% urlgrabber/3.10 57 0.00% Debian APT-HTTP/1.3 (1.5~rc1) 57 0.00% Java/1.8.0_144 56 0.00% apt-cacher/1.6.12 libcurl/7.21.0 GnuTLS/2.8.6 zlib/1.2.3.4 libidn/1.15 55 0.00% python-requests/2.6.0 CPython/2.6.6 Linux/2.6.32-573.12.1.el6.x86_64 55 0.00% urlgrabber/3.1.0 yum/3.2.22 53 0.00% HTTP-Tiny/0.056_001 53 0.00% HellEngine/2.0 (Linux) HellChecker/2.0 45 0.00% Wget/1.10.2 (Red Hat modified) 44 0.00% HTTP-Tiny/0.068 43 0.00% HTTP-Tiny/0.022 42 0.00% ZmEu 40 0.00% Debian APT-HTTP/1.3 (1.3.3) 38 0.00% Debian APT-HTTP/1.3 (1.4.8) 37 0.00% Debian APT-HTTP/1.3 (1.2.24) BMID/E67A4442B8 37 0.00% Dillo/0.8.6-i18n-misc 37 0.00% Go-http-client/1.1 37 0.00% ia_archiver 36 0.00% HTTP-Tiny/0.024 32 0.00% python-requests/2.6.0 CPython/2.7.5 Linux/3.10.0-693.1.1.el7.x86_64 31 0.00% Cpanel::HttpRequest/2.1 29 0.00% ostree libsoup/2.56.0 28 0.00% curl/7.19.7 (x86_64-redhat-linux-gnu) libcurl/7.19.7 NSS/3.15.3 zlib/1.2.3 libidn/1.18 libssh2/1.4.2 28 0.00% python-requests/2.6.0 CPython/2.7.5 Linux/3.10.0-693.2.2.el7.x86_64 27 0.00% Debian APT-HTTP/1.3 (1.3.4) 26 0.00% Debian APT-HTTP/1.3 (0.8.3ubuntu7) 26 0.00% HTTP-Tiny/0.017 25 0.00% Mozilla/4.0 (compatible; MSIE 8.0; Windows NT 5.1; Trident/4.0; .NET CLR 2.0.50727) 25 0.00% Wget(linux) 25 0.00% libwww-perl/6.04 25 0.00% libwww-perl/6.27 23 0.00% lftp/4.0.9 23 0.00% ostree libsoup/2.60.0 22 0.00% Debian APT-HTTP/1.3 (0.9.7.5ubuntu5.1) 22 0.00% ostree libsoup/2.52.2 21 0.00% python-requests/2.6.0 CPython/2.7.5 Linux/3.10.0-514.6.1.el7.x86_64 20 0.00% HTTP-Tiny/0.018 20 0.00% libwww-perl/6.13 17 0.00% Debian APT-HTTP/1.3 (1.3.1) 17 0.00% curl/7.21.7 (i586-mandriva-linux-gnu) libcurl/7.21.7 OpenSSL/1.0.0d zlib/1.2.5 libidn/1.22 libssh2/1.2.8 16 0.00% ansible-httpget 16 0.00% centos.org daily timestamp checker; avij at centosproject dot org 15 0.00% Wget/1.19.1 (linux-gnu) 14 0.00% sysscan/1.0 (https://github.com/robertdavidgraham/sysscan) 13 0.00% BUbiNG (+http://law.di.unimi.it/BUbiNG.html) 13 0.00% HTTP-Tiny/0.013 12 0.00% Debian APT-HTTP/1.3 (0.8.13.2ubuntu4.6) 12 0.00% Debian APT-HTTP/1.3 (1.5) 12 0.00% Debian APT-HTTP/1.3 (1.5~rc3) 12 0.00% HTTP-Tiny/0.029 12 0.00% VenusCrawler/Nutch-1.12 (crawler@mycompany.com) 12 0.00% ostree libsoup/2.58.1 12 0.00% python-requests/2.4.3 CPython/2.7.5 Linux/3.10.0-514.26.2.el7.x86_64 11 0.00% Sogou web spider/4.0(+http://www.sogou.com/docs/help/webmasters.htm#07) 10 0.00% Barkrowler 0.1.6 10 0.00% Debian APT-HTTP/1.3 (0.8.16~exp5ubuntu13) 10 0.00% libwww-perl/6.03 10 0.00% libwww-perl/6.25 9 0.00% Auto Spider 1.0 9 0.00% Python-urllib/2.7 9 0.00% curl/7.19.4 (i586-mandriva-linux-gnu) libcurl/7.19.4 GnuTLS/2.6.4 zlib/1.2.3 c-ares/1.6.0 libidn/1.13 libssh2/1.0 9 0.00% masscan/1.0 8 0.00% HTTP-Tiny/0.020 8 0.00% Nutch Master Test/Nutch-1.13-SNAPSHOT 8 0.00% Scanbot 8 0.00% libwww-perl/5.805 7 0.00% HTTP-Tiny/0.036 7 0.00% Kodi/15.2 (Windows NT 6.1) App_Bitness/32 Version/15.2 Git:2015-10-19-02e7013 7 0.00% Python-urllib/1.17 7 0.00% Ubuntu APT-HTTP/1.3 (0.7.25.3ubuntu9.17.1) 7 0.00% libwww-perl/6.08 6 0.00% Artifactory/5.4.4 6 0.00% PycURL/7.29.0 6 0.00% Y!J-ASR/1.0 crawler (http://www.yahoo-help.jp/app/answers/detail/p/595/a_id/42716/) 6 0.00% curl/7.51.0 6 0.00% ostree libsoup/2.56.1 6 0.00% urlgrabber/3.9.1 5 0.00% HTTP-Tiny/0.034 5 0.00% NYU internet census 5 0.00% curl/7.19.7 (x86_64-redhat-linux-gnu) libcurl/7.19.7 NSS/3.21 Basic ECC zlib/1.2.3 libidn/1.18 libssh2/1.4.2 5 0.00% iPXE/1.0.0+ (d0bfd) 5 0.00% libwww-perl/5.837 5 0.00% python-requests/2.6.0 CPython/2.7.5 Linux/3.10.0-693.el7.x86_64 5 0.00% the beast 4 0.00% Debian APT-HTTP/1.3 (1.5~beta2) 4 0.00% Flock/8.6 (AmigaOS 3.1; en_NZ;) 4 0.00% GarlikCrawler/1.2 (http://garlik.com/, crawler@garlik.com) 4 0.00% HEADMasterSEO 4 0.00% Microsoft Internet Explorer/4.0b1 (Windows 95) 4 0.00% Mozilla/4.0 (compatible; Netcraft Web Server Survey) 4 0.00% PycURL/7.19.3 libcurl/7.38.0 GnuTLS/3.2.16 zlib/1.2.8 libidn/1.28 librtmp/2.3 4 0.00% Python-urllib/2.6 4 0.00% Scrapy/1.4.0 (+http://scrapy.org) 4 0.00% Telesphoreo 4 0.00% Ubuntu APT-HTTP/1.3 (0.7.25.3ubuntu9.4) 4 0.00% WordPress/4.8.2; https://www.upcloud.com/support 4 0.00% python-requests/2.9.1 3 0.00% Java/1.8.0_131 3 0.00% Mozilla/4.0 (compatible; MSIE 8.0; Windows NT 6.1) 3 0.00% Slackbot-LinkExpanding 1.0 (+https://api.slack.com/robots) 3 0.00% TelegramBot (like TwitterBot) 3 0.00% Wget/1.11.4 3 0.00% WordPress/4.7.6; http://45.78.63.253 3 0.00% apt-cacher/1.7.3 libcurl/7.22.0 GnuTLS/2.12.14 zlib/1.2.3.4 libidn/1.23 librtmp/2.3 3 0.00% facebookexternalhit/1.1;line-poker/1.0 3 0.00% iPXE/1.0.0+ (fa9b) 3 0.00% python-requests/2.14.2 3 0.00% python-requests/2.6.0 CPython/2.7.5 Linux/3.10.0-327.36.2.el7.x86_64 3 0.00% yacybot (webportal-global; amd64 Linux 4.9.0-3-amd64; java 9; Europe/de) http://yacy.net/bot.html 2 0.00% ELinks/0.12pre6 (textmode; Linux; 238x67-2) 2 0.00% HTTP-Tiny/0.054 2 0.00% Java/1.8.0_45 2 0.00% Lynx/2.8.5rel.1 libwww-FM/2.14 SSL-MM/1.4.1 OpenSSL/0.9.8e-fips-rhel5 2 0.00% Mozilla/4.0 (compatible; MSIE 8.0; Windows NT 6.1; Trident/4.0) 2 0.00% Mozilla/4.0 (compatible; Win32; WinHttp.WinHttpRequest.5) 2 0.00% Python/3.4 aiohttp/2.1.0 2 0.00% SBL-BOT (http://sbl.net) 2 0.00% SEMrushBot 2 0.00% T-Online Browser 2 0.00% Ubuntu APT-HTTP/1.3 (0.7.20.2ubuntu6) 2 0.00% Ubuntu APT-HTTP/1.3 (0.7.25.3ubuntu7) 2 0.00% curl/7.54.1 2 0.00% libdnf/0.9.3 2 0.00% libwww-perl/5.833 2 0.00% nutch-1.4/Nutch-1.4 2 0.00% python-requests/2.18.3 2 0.00% python-requests/2.6.0 CPython/2.7.5 Linux/3.10.0-514.21.1.el7.x86_64 2 0.00% python-requests/2.6.0 CPython/2.7.5 Linux/3.10.0-514.el7.x86_64 2 0.00% rogerbot/1.1 (http://moz.com/help/guides/search-overview/crawl-diagnostics#more-help, rogerbot-crawler+pr4-crawler-15@moz.com) 2 0.00% urlgrabber/3.9.1 yum/3.4.3 2 0.00% www.probethenet.com scanner 2 0.00% yacybot (/global; amd64 Linux 4.12.9-300.fc26.x86_64; java 1.8.0_144; Europe/pl) http://yacy.net/bot.html 2 0.00% }__test|O:21:\ 1 0.00% ) { :;}; /bin/bash -c 1 0.00% 777Siters/1.05 (+http://777s.ru/siters/) 1 0.00% Artifactory/4.4.3 1 0.00% Chef Client/11.2.0 (ruby-1.9.3-p286; ohai-6.16.0; x86_64-linux; +http://opscode.com) 1 0.00% Cloud mapping experiment searching for shoutcast servers. Contact research@pdrlabs.net 1 0.00% Default 1 0.00% Dillo/0.8.5-i18n-misc 1 0.00% Express WebPictures (www.express-soft.com) 1 0.00% GigablastOpenSource/1.0 1 0.00% Grasshopper 1 0.00% HTTP-Tiny/0.011 1 0.00% HTTP-Tiny/0.021 1 0.00% HTTP-Tiny/0.037 1 0.00% HTTP-Tiny/0.043 1 0.00% HTTP-Tiny/0.050 1 0.00% HTTP-Tiny/0.053 1 0.00% IBrowse/2.2 (AmigaOS 3.5) 1 0.00% KHTML, like Gecko) Chrome/36.0.1944.0 Safari/537.3 1 0.00% Lynx/2.8.6rel.5 libwww-FM/2.14 SSL-MM/1.4.1 OpenSSL/1.0.0-fips 1 0.00% Mozilla/4.0 (compatible; ibisBrowser) 1 0.00% Mozilla/4.0 (compatible;) 1 0.00% Mozilla/4.02 [en] (X11; I; SunOS 5.6 sun4u) 1 0.00% Nutch_Master/Nutch-1.13-SNAPSHOT 1 0.00% PycURL/7.19.3 libcurl/7.37.1 GnuTLS/3.2.16 zlib/1.2.8 libidn/1.28 librtmp/2.3 1 0.00% PycURL/7.19.3 libcurl/7.47.0 GnuTLS/3.2.11 zlib/1.2.8 libidn/1.28 librtmp/2.3 1 0.00% PycURL/7.19.5 libcurl/7.38.0 GnuTLS/3.3.8 zlib/1.2.8 libidn/1.29 libssh2/1.4.3 librtmp/2.3 1 0.00% RMA/1.0 (compatible; RealMedia) 1 0.00% Ruby 1 0.00% SuperFlyyyyTigerBot 1 0.00% Sylera/1.2.x 1 0.00% TulipChain/5.x (http://ostermiller.org/tulipchain/) Java/1.x.1_0x (http://java.sun.com/) Linux/2.4.17 1 0.00% UPG1 UP/4.0 (compatible; Blazer 1.0) 1 0.00% Ubuntu APT-HTTP/1.3 (0.7.25.3ubuntu9.14) 1 0.00% WordPress/4.8.2; http://home_wp.marthemed.org 1 0.00% YisouSpider 1 0.00% ZYpp 16.15.3 (curl 7.53.1) 1 0.00% apache 1 0.00% bluefish 0.6 HTML editor 1 0.00% centos.org daily timestamp checker; centos at miuku dot net 1 0.00% crawler4j (https://github.com/yasserg/crawler4j/) 1 0.00% curl/7.19.7 (x86_64-redhat-linux-gnu) libcurl/7.19.7 NSS/3.14.0.0 zlib/1.2.3 libidn/1.18 libssh2/1.4.2 1 0.00% curl/7.20.1 (i586-mandriva-linux-gnu) libcurl/7.20.1 OpenSSL/1.0.0a zlib/1.2.3 libidn/1.18 libssh2/1.2.5 1 0.00% curl/7.47.0 1 0.00% curl/7.49.0 1 0.00% curl/7.54.0 1 0.00% libwww-perl/6.23 1 0.00% masscan/1.0 (https://github.com/robertdavidgraham/masscan) 1 0.00% okhttp/2.7.5 1 0.00% ostree libsoup/2.48.1 1 0.00% other 1 0.00% python-requests/2.10.0 1 0.00% python-requests/2.6.0 CPython/2.7.5 Linux/3.10.0-514.16.1.el7.x86_64 1 0.00% python-requests/2.6.0 CPython/2.7.5 Linux/3.10.0-514.21.2.el7.x86_64 1 0.00% tigerbot 1 0.00% urlgrabber/3.10.1 yum/3.4.3 1 0.00% yacybot (-global; amd64 Windows 2003 5.2; java 1.8.0_131; Europe/en) http://yacy.net/bot.html