|
Spider |
Hits |
% of Total |
Visits |
1 |
BaiDu Spider |
6,435,698 |
24.46% |
531,119 |
2 |
Bing Spider |
6,425,565 |
24.42% |
5,252 |
3 |
Google Spider |
4,333,581 |
16.47% |
78,527 |
4 |
Yahoo Spider |
1,742,586 |
6.62% |
4,755 |
5 |
Yandex Spider |
1,731,361 |
6.58% |
6,976 |
6 |
ArchiveTeam+ArchiveBot/ 20161026.02_UAT+(wpull+1.2.3)+and+not+Moz illa/ 5.0+(Windows+NT+6.1;+WOW64)+AppleWebKit/ 537.36+(KHTML,+like+Gecko)+Chrome/ 42.0.2311.90+Safari/ 537.36 |
1,323,737 |
5.03% |
19 |
7 |
Wespe.de Spider |
1,047,388 |
3.98% |
206,422 |
8 |
magpie-crawler/1.1+(U;+Linux+amd64;+en-GB ;++http:/ / www.brandwatch.net) |
916,787 |
3.48% |
139 |
9 |
Treato-Bot/1.0+(TREATO+LTD,+www.treato.co m,+mailto:+botadmin@treato.com) |
564,642 |
2.15% |
15 |
10 |
Sogou Spider |
250,769 |
0.95% |
2,638 |
11 |
Vegi+bot+(we+follow+your+robots.txt+setti ngs+before+crawling,+you+can+slow+down+th e+bot+by+change+the+Crawl-Delay+parameter +in+the+settings.if+you+have+an+enquiry,+ please+email+to:+abuse-report@terrykylese oagency.com) |
222,617 |
0.85% |
13,270 |
12 |
Mozilla/5.0+(compatible;+MegaIndex.ru/ 2.0;++http:/ / megaindex.com/ crawler) |
172,068 |
0.65% |
27 |
13 |
Mozilla/5.0+(Windows;+U;+Windows+NT+6.0;+ en-GB;+rv:1.0;+trendictionbot0.5.0;+trend iction+search;+http:/ / www.trendiction.de/ bot;+please+let+us+know+of+any+problems;+ web+at+trendiction.com)+Gecko/ 20071127+Firefox/ 3.0.0.11 |
111,059 |
0.42% |
79,704 |
14 |
Mozilla/5.0+(compatible;+MJ12bot/ v1.4.5;+http:/ / www.majestic12.co.uk/ bot.php? +) |
94,181 |
0.36% |
840 |
15 |
Google image crawler |
90,004 |
0.34% |
424 |
16 |
Mozilla/5.0+(compatible;+LinkpadBot/ 1.08;++http:/ / www.linkpad.ru) |
66,789 |
0.25% |
3,179 |
17 |
Mozilla/5.0+(compatible;+BLEXBot/ 1.0;++http:/ / webmeup-crawler.com/ ) |
62,221 |
0.24% |
429 |
18 |
Mozilla/5.0+(compatible;+proximic;++http: / / www.proximic.com/ info/ spider.php) |
57,296 |
0.22% |
48,223 |
19 |
Facebook external hit |
56,365 |
0.21% |
41,994 |
20 |
Mozilla/5.0+(compatible;+MJ12bot/ v1.4.7;+http:/ / mj12bot.com/ ) |
49,884 |
0.19% |
956 |
21 |
Clickagy+Intelligence+Bot+v2 |
44,675 |
0.17% |
23,897 |
22 |
Mozilla/5.0+(compatible;+SeznamBot/ 3.2;++http:/ / napoveda.seznam.cz/ en/ seznambot-intro/ ) |
41,256 |
0.16% |
864 |
23 |
Mozilla/5.0+(compatible;+Steeler/ 3.5;+http:/ / www.tkl.iis.u-tokyo.ac.jp/ ~crawler/ ) |
39,917 |
0.15% |
317 |
24 |
MSN Spider |
39,025 |
0.15% |
171 |
25 |
robots |
34,067 |
0.13% |
2,155 |
26 |
GridBot/1.0+crawler@sysomos.com |
33,223 |
0.13% |
1,131 |
27 |
Mozilla/5.0+(compatible;+DotBot/ 1.1;+http:/ / www.opensiteexplorer.org/ dotbot,+help@moz.com) |
31,221 |
0.12% |
1,315 |
28 |
Mozilla/5.0+(Macintosh;+Intel+Mac+OS+X+10 _10_1)+AppleWebKit/ 537.36+(KHTML,+like+Gecko)+Chrome/ 40.0.2214.111+Safari/ 537.36+moatbot |
26,451 |
0.10% |
8,812 |
29 |
Mozilla/5.0+(compatible;+Linux+x86_64;+Ma il.RU_Bot/ 2.0;++http:/ / go.mail.ru/ help/ robots) |
25,576 |
0.10% |
774 |
30 |
Mozilla/5.0+(compatible;+GrapeshotCrawler / 2.0;++http:/ / www.grapeshot.co.uk/ crawler.php) |
23,754 |
0.09% |
10,010 |
31 |
BoardReader/1.0+(http:/ / spider.boardreader.com) |
20,719 |
0.08% |
4,217 |
32 |
Mozilla/5.0+(Macintosh;+Intel+Mac+OS+X+10 _10_1)+AppleWebKit/ 600.2.5+(KHTML,+like+Gecko)+Version/ 8.0.2+Safari/ 600.2.5+(Applebot/ 0.1;++http:/ / www.apple.com/ go/ applebot) |
17,780 |
0.07% |
479 |
33 |
Mozilla/5.0+(compatible;+XoviBot/ 2.0;++http:/ / www.xovibot.net/ ) |
17,202 |
0.07% |
2,936 |
34 |
Mozilla/5.0+(compatible;+SemrushBot/ 1.1~bl;++http:/ / www.semrush.com/ bot.html) |
13,545 |
0.05% |
521 |
35 |
R6_FeedFetcher_(www.radian6.com/ crawler) |
12,407 |
0.05% |
151 |
36 |
MaxPointCrawler/Nutch-1.10+(maxpoint.craw ler+at+maxpointinteractive+dot+com) |
10,511 |
0.04% |
546 |
37 |
Mozilla/5.0+(compatible;+ZumBot/ 1.0;+http:/ / help.zum.com/ inquiry) |
10,170 |
0.04% |
10 |
38 |
istellabot/t.1 |
9,909 |
0.04% |
125 |
39 |
YisouSpider |
9,118 |
0.03% |
1,463 |
40 |
Mozilla/5.0+(compatible;+MSIE+9.0;+Window s+NT+6.1;+Trident/ 5.0);+360Spider(compatible;+HaosouSpider; +http:/ / www.haosou.com/ help/ help_3_2.html) |
7,343 |
0.03% |
6,168 |
41 |
Yandex Images Spider |
7,037 |
0.03% |
1,428 |
42 |
Mozilla/5.0+(compatible;+Cliqzbot/ 1.0++http:/ / cliqz.com/ company/ cliqzbot) |
6,680 |
0.03% |
1,184 |
43 |
Mozilla/5.0+(compatible;+MJ12bot/ v1.4.6;+http:/ / mj12bot.com/ ) |
6,065 |
0.02% |
101 |
44 |
Mozilla/5.0+(compatible;+spbot/ 5.0.3;++http:/ / OpenLinkProfiler.org/ bot+) |
4,763 |
0.02% |
14 |
45 |
Mozilla/5.0+(compatible;+linkdexbot/ 2.0;++http:/ / www.linkdex.com/ bots/ ) |
4,390 |
0.02% |
1,564 |
46 |
Google Feedfetcher |
4,243 |
0.02% |
1,780 |
47 |
Alexa Spider |
4,156 |
0.02% |
595 |
48 |
Domain+Re-Animator+Bot+(http:/ / domainreanimator.com)+-+support@domainrea nimator.com |
2,978 |
0.01% |
8 |
49 |
yacybot+(/global;+amd64+Linux+3.16.0-4-am d64;+java+1.8.0_40;+Europe/ en)+http:/ / yacy.net/ bot.html |
2,549 |
0.01% |
191 |
50 |
Mediatoolkitbot+(complaints@mediatoolkit. com) |
2,297 |
0.01% |
406 |
|
Subtotal |
26,267,625 |
99.85% |
1,098,241 |
|
Total |
26,307,415 |
100.00% |
1,110,048 |
|
