Jun'uary
Jan'uary » 日志 » 搜索机器人分析
搜索机器人分析
Jan 发表于 2006-05-09 13:44:23
这位老兄自己创建了2^30-1个网页，目的是为了比较各大引擎蜘蛛的能力。精神可嘉，得出的BST图片颇有美感，有点像分形艺术。
| Yahoo! | MSN | ||
|---|---|---|---|
| total number of pageviews | 1,030,396 | 20,633 | 4,699 |
| number of nodes crawled | 105,971 | 7,556 | 1,390 |
| percentage of tree crawled | 0.0049% | 0.00035% | 0.000065% |
| number of indexed nodes | 120,000 | 554 | 1 |
| indexed/crawled ratio | 113.23% | 7.33% | 0.07% |
Yahoo! Slurp
- large version (4273x3090, 1.5MB)
- animated version over 1 year (2005-04-13 - 2006-04-13, 13MB)
- animated version of the first 2 hours (2006-04-14 00:40:00-02:40:00, 2.2MB)
Googlebot
- large version (4067x4815, 180kB)
- animated version (2005-04-13 - 2006-04-13, 1.2MB)
MSNbot
- large version (4200x2795, 123kB)
- animated version (2005-04-13 - 2006-04-13, 846kB)
曾经的这一天...
- » 2005年: An explaination of Debian branches
- » 2005年: The world spam center
- » 2005年: Result from the 2004 Desktop Linux Market Survey
相关日志:
收藏:
QQ书签
del.icio.us
订阅:
Google
抓虾
