55 different robots | Hits | Bandwidth | Last visit |
SemrushBot | 85,271+1715 | 975.05 MB | 29 Mar 2024 - 18:47 |
nbot | 73,650+56 | 705.63 MB | 29 Mar 2024 - 15:50 |
AhrefsBot | 73,505+146 | 905.92 MB | 29 Mar 2024 - 18:48 |
YandexBot | 41,868+5997 | 686.79 MB | 29 Mar 2024 - 18:46 |
MJ12bot | 21,245+283 | 394.00 MB | 29 Mar 2024 - 17:54 |
Unknown robot (identified by hit on robots.txt) | 0+18486 | 69.95 MB | 29 Mar 2024 - 18:48 |
DotBot | 16,046+1086 | 1.85 GB | 29 Mar 2024 - 18:40 |
bingbot | 11,642+89 | 150.44 MB | 29 Mar 2024 - 18:46 |
crawl | 10,998+65 | 104.07 MB | 29 Mar 2024 - 18:10 |
sift | 9,889+8 | 94.57 MB | 25 Mar 2024 - 16:51 |
Unknown robot identified by bot\* | 9,773+71 | 2.11 GB | 29 Mar 2024 - 18:06 |
seek | 6,696+1 | 104.41 MB | 12 Mar 2024 - 08:06 |
BLEXBot | 5,719+31 | 89.60 MB | 26 Mar 2024 - 18:24 |
oBot | 5,014+19 | 34.82 MB | 29 Mar 2024 - 05:50 |
Googlebot | 3,583+101 | 59.54 MB | 29 Mar 2024 - 18:43 |
netEstate NE Crawler | 1,833+38 | 19.08 MB | 08 Mar 2024 - 22:24 |
feed | 1,607+77 | 25.83 MB | 29 Mar 2024 - 18:23 |
Mail.RU Bot | 1,036+133 | 18.95 MB | 29 Mar 2024 - 18:22 |
core | 434+5 | 13.07 MB | 29 Mar 2024 - 11:56 |
Applebot | 219+49 | 3.09 MB | 29 Mar 2024 - 18:34 |
Unknown robot identified by \*bot | 235+1 | 4.04 MB | 29 Mar 2024 - 16:56 |
Yandex ( catchall ) | 235 | 6.32 MB | 28 Mar 2024 - 19:28 |
empty user agent string | 189+3 | 20.06 MB | 25 Mar 2024 - 10:42 |
python | 158+3 | 15.62 MB | 27 Mar 2024 - 04:40 |
YisouSpider | 107+1 | 2.74 MB | 22 Mar 2024 - 22:59 |
seokicks.de | 98+2 | 1.72 MB | 16 Mar 2024 - 02:51 |
qwantify | 48+43 | 582.29 KB | 13 Mar 2024 - 11:41 |
CCBot | 84+1 | 467.48 KB | 04 Mar 2024 - 16:28 |
link | 55+2 | 1.34 MB | 28 Mar 2024 - 03:57 |
Firefox version 10 and lower - various robots | 51+4 | 682.86 KB | 29 Mar 2024 - 01:13 |
Apache-HttpClient | 38 | 534.78 KB | 14 Mar 2024 - 05:30 |
Sogou web spider | 34 | 594.34 KB | 28 Mar 2024 - 16:56 |
custo | 22 | 1.56 MB | 28 Mar 2024 - 05:54 |
Baiduspider | 21 | 499.77 KB | 25 Mar 2024 - 03:25 |
facebookexternalhit | 17+2 | 5.13 MB | 27 Mar 2024 - 16:01 |
drupal | 15 | 57.86 KB | 28 Mar 2024 - 07:15 |
DuckDuckGo-Favicons-Bot | 14 | 181.93 KB | 28 Mar 2024 - 13:56 |
Konqueror | 13+1 | 165.33 KB | 28 Mar 2024 - 03:57 |
TelegramBot | 9 | 4.82 MB | 28 Mar 2024 - 06:33 |
Dalvik | 9 | 157.26 KB | 18 Mar 2024 - 17:51 |
netcraft | 8 | 724.35 KB | 06 Mar 2024 - 09:48 |
coccoc | 4+4 | 107.65 KB | 23 Mar 2024 - 17:34 |
urllib | 7 | 434.60 KB | 12 Mar 2024 - 04:49 |
nutch ( catchall ) | 2+2 | 29.30 KB | 28 Mar 2024 - 16:22 |
SurdotlyBot | 4 | 59.32 KB | 26 Mar 2024 - 21:16 |
MSIE 5 - ( Rogue Robot ) | 3 | 22.56 KB | 28 Mar 2024 - 03:28 |
Baidu ( catchall ) | 2 | 19.78 KB | 10 Mar 2024 - 08:25 |
MSIE 6 - ( Rogue Robot ) | 2 | 22.34 KB | 23 Mar 2024 - 03:11 |
Curl | 2 | 196.89 KB | 16 Mar 2024 - 01:25 |
Exabot | 1 | 9.52 KB | 28 Mar 2024 - 03:53 |
LinkCheck | 1 | 21.62 KB | 25 Mar 2024 - 19:57 |
Googlebot-Mobile | 1 | 67.22 KB | 17 Mar 2024 - 16:05 |
BingPreview | 1 | 51.32 KB | 20 Mar 2024 - 12:00 |
Xenu Link Sleuth | 1 | 3.81 KB | 25 Mar 2024 - 21:22 |
360Spider | 1 | 17.83 KB | 11 Mar 2024 - 10:17 |
|