Robots |
1 | 199 | 27.75 | Yahoo! Slurp |
2 | 161 | 22.45 | YandexBot/3.0 |
3 | 148 | 20.64 | Googlebot/2.1 |
4 | 65 | 9.07 | msnbot/2.0b (+http://search.msn.com/msnb... |
5 | 48 | 6.69 | Googlebot-Image/1.0 |
6 | 21 | 2.93 | msnbot/2.0b (+http://search.msn.com/msnb... |
7 | 16 | 2.23 | MLBot (www.metadatalabs.com/mlbot) |
8 | 14 | 1.95 | compatible Mozilla/5.0 |
9 | 12 | 1.67 | Exabot/3.0 |
10 | 7 | 0.98 | TurnitinBot/2.1 (http://www.turnitin.com... |
11 | 4 | 0.56 | msnbot-media/1.1 (+http://search.msn.com... |
12 | 4 | 0.56 | Jyxobot/1 |
13 | 4 | 0.56 | oBot |
14 | 4 | 0.56 | ia_archiver-web.archive.org |
15 | 2 | 0.28 | Fedora/1.0.7 |
16 | 2 | 0.28 | Googlebot/2.1 (+http://www.google.com/bo... |
17 | 2 | 0.28 | Plukkie/1.3 |
18 | 2 | 0.28 | CCBot/1.0 (+http://www.commoncrawl.org/b... |
19 | 2 | 0.28 | Baiduspider+(+http://www.baidu.com/searc... |