89 different robots | Hits | Bandwidth | Last visit |
Curl | 501,090 | 598.92 GB | 26 Apr 2024 - 13:30 |
Unknown robot identified by bot\* | 183,707+1124 | 98.14 GB | 26 Apr 2024 - 13:30 |
SemrushBot | 180,497 | 5.71 GB | 26 Apr 2024 - 13:17 |
Googlebot | 62,505+17 | 11.76 GB | 26 Apr 2024 - 13:29 |
sift | 41,516 | 1.57 GB | 25 Apr 2024 - 22:11 |
bingbot | 39,986+29 | 10.04 GB | 26 Apr 2024 - 13:28 |
nbot | 37,155+18 | 3.49 GB | 26 Apr 2024 - 10:35 |
DotBot | 15,623+658 | 4.65 GB | 26 Apr 2024 - 13:15 |
YandexBot | 12,317+42 | 1.78 GB | 26 Apr 2024 - 13:28 |
CCBot | 8,490+2 | 337.48 MB | 25 Apr 2024 - 17:31 |
Applebot | 5,837+6 | 184.45 MB | 26 Apr 2024 - 13:20 |
BLEXBot | 5,396+6 | 311.97 MB | 25 Apr 2024 - 13:46 |
linkchecker | 5,020 | 31.24 MB | 26 Apr 2024 - 13:16 |
Firefox version 10 and lower - various robots | 4,511+2 | 95.01 MB | 25 Apr 2024 - 16:21 |
nutch ( catchall ) | 3,952+9 | 772.05 MB | 23 Apr 2024 - 20:56 |
feed | 2,581+8 | 138.46 MB | 26 Apr 2024 - 13:29 |
Googlebot-Image | 2,371 | 380.15 MB | 26 Apr 2024 - 13:16 |
MJ12bot | 2,106+27 | 74.63 MB | 26 Apr 2024 - 11:31 |
Mail.RU Bot | 1,556 | 1.53 GB | 26 Apr 2024 - 13:28 |
Dalvik | 1,397 | 2.20 GB | 26 Apr 2024 - 11:42 |
Yandex ( catchall ) | 1,214 | 18.02 MB | 26 Apr 2024 - 02:08 |
Wget | 1,005 | 5.64 GB | 25 Apr 2024 - 16:43 |
Python-urllib | 971 | 7.88 MB | 26 Apr 2024 - 13:10 |
Baiduspider | 920 | 255.93 MB | 26 Apr 2024 - 12:39 |
mozilla/5.0 - ( Rogue Robot ) | 912 | 9.35 MB | 26 Apr 2024 - 02:38 |
Java ( catchall ) | 626+1 | 15.65 MB | 26 Apr 2024 - 06:52 |
Barkrowler | 477+2 | 86.82 MB | 23 Apr 2024 - 16:42 |
Mozilla ( Rogue Robot ) | 451 | 3.34 MB | 26 Apr 2024 - 12:06 |
MSIE 6 - ( Rogue Robot ) | 414 | 218.79 MB | 26 Apr 2024 - 13:27 |
Unknown robot (identified by hit on robots.txt) | 0+365 | 278.32 MB | 24 Apr 2024 - 15:38 |
empty user agent string | 297 | 1.03 GB | 26 Apr 2024 - 12:59 |
python | 294 | 468.84 MB | 26 Apr 2024 - 13:07 |
facebookexternalhit | 216+1 | 124.52 MB | 26 Apr 2024 - 13:14 |
Yahoo! Slurp | 202 | 4.58 MB | 17 Apr 2024 - 07:12 |
coccoc | 151 | 7.22 MB | 26 Apr 2024 - 10:15 |
Unknown robot identified by \*bot | 149 | 18.50 MB | 25 Apr 2024 - 21:05 |
core | 117+6 | 47.42 MB | 26 Apr 2024 - 06:45 |
yak-linkfluence | 118 | 1.30 MB | 17 Apr 2024 - 18:32 |
crawl | 116+1 | 41.11 MB | 26 Apr 2024 - 12:47 |
YandexImages | 88 | 6.51 MB | 26 Apr 2024 - 05:36 |
seek | 74 | 56.83 MB | 21 Apr 2024 - 23:58 |
Baidu ( catchall ) | 72 | 33.91 MB | 25 Apr 2024 - 16:29 |
qwantify | 67+3 | 3.97 MB | 22 Apr 2024 - 19:21 |
BingPreview | 62 | 14.54 MB | 26 Apr 2024 - 07:31 |
AhrefsBot | 10+49 | 6.41 MB | 26 Apr 2024 - 08:00 |
link | 39 | 258.58 KB | 25 Apr 2024 - 18:32 |
MojeekBot | 36 | 109.04 KB | 25 Apr 2024 - 13:05 |
CFNetwork | 32 | 101.42 MB | 24 Apr 2024 - 23:36 |
SeznamBot | 25 | 2.85 MB | 25 Apr 2024 - 10:22 |
Google Web Preview | 20 | 68.24 KB | 17 Apr 2024 - 00:51 |
Go-http-client | 17 | 59.29 KB | 20 Apr 2024 - 12:24 |
robot | 16 | 1.03 MB | 13 Apr 2024 - 14:24 |
internetarchive | 12 | 10.20 KB | 24 Apr 2024 - 03:57 |
DuckDuckGo-Favicons-Bot | 12 | 97.03 KB | 24 Apr 2024 - 06:22 |
Apache-HttpClient | 10 | 77.69 KB | 21 Apr 2024 - 03:53 |
yeti | 10 | 718.16 KB | 22 Apr 2024 - 14:37 |
Discordbot | 10 | 1.14 MB | 25 Apr 2024 - 12:43 |
scrapy | 9 | 535.94 KB | 06 Apr 2024 - 10:47 |
Screaming Frog SEO Spider | 9 | 14.08 KB | 23 Apr 2024 - 09:48 |
YisouSpider | 6 | 3.08 MB | 23 Apr 2024 - 14:29 |
Velen | 6 | 35.66 KB | 25 Apr 2024 - 09:51 |
ia_archiver | 5 | 38.72 KB | 09 Apr 2024 - 21:11 |
bnf.fr_bot | 5 | 1.42 MB | 20 Apr 2024 - 05:33 |
twitterbot | 5 | 18.76 KB | 21 Apr 2024 - 10:48 |
TelegramBot | 4 | 7.84 MB | 22 Apr 2024 - 20:22 |
LinkCheck | 4 | 14.70 KB | 11 Apr 2024 - 03:15 |
Pinterestbot | 4 | 6.27 KB | 24 Apr 2024 - 02:56 |
netcraft | 4 | 38.24 KB | 01 Apr 2024 - 22:43 |
Nautic Expo using Firefox/1.5 | 3 | 224.05 KB | 23 Apr 2024 - 19:35 |
y!j | 2+1 | 516.25 KB | 09 Apr 2024 - 09:36 |
wordpress | 3 | 1.20 MB | 09 Apr 2024 - 13:58 |
drupal | 3 | 22.75 KB | 21 Apr 2024 - 20:46 |
yacybot | 3 | 9.56 KB | 14 Apr 2024 - 03:05 |
webcopy | 3 | 871 Bytes | 18 Apr 2024 - 15:52 |
proximic | 2 | 17.39 KB | 10 Apr 2024 - 09:37 |
Mediapartners-Google | 2 | 1.58 KB | 09 Apr 2024 - 10:35 |
archive.org_bot | 2 | 6.07 KB | 23 Apr 2024 - 23:50 |
trendiction | 1 | 2.19 KB | 11 Apr 2024 - 22:27 |
SemrushBot-SI | 1 | 577.63 KB | 20 Apr 2024 - 21:08 |
phantom | 1 | 1.81 MB | 15 Apr 2024 - 00:04 |
ELinks | 1 | 132.88 KB | 20 Apr 2024 - 18:13 |
riddler | 1 | 136.88 KB | 26 Apr 2024 - 04:21 |
Yahoo Link Preview | 1 | 4.21 KB | 17 Apr 2024 - 13:05 |
Slackbot-LinkExpanding | 1 | 32.34 KB | 03 Apr 2024 - 13:58 |
microsoft-webdav-miniredir | 1 | 258 Bytes | 19 Apr 2024 - 19:07 |
Xenu Link Sleuth | 1 | 230 Bytes | 07 Apr 2024 - 16:55 |
Windows 99 - ( Rogue Robot ) | 1 | 347.07 KB | 07 Apr 2024 - 14:25 |
checker | 1 | 693.48 KB | 08 Apr 2024 - 12:37 |
motor | 1 | 121.40 KB | 03 Apr 2024 - 15:08 |
|