Another Adam Bosworth sighting | 31 Mar 2006

23:05 Notes to the Day » Wangjianshuo's blog

1. Server changed to bluehost.com. They seem good. The transition is smooth (pretty smooth), but I still lost some comments (5?). Feel bad about it. 2. Back from Donews gathering this year. Had wonderful dinner with Friends. 3. Went to Internet cafe again. 4. Focus Group is really helpful. 5. It is better to go to bed now....

22:32 新旧媒体广告数据 » laolu

一个多月前记录过《新旧媒体广告PK》，数据不多。今天在美国报业协会（Newspaper Association of America）的网站上找到大量数据，记录如下：

季度数据，美国报纸在线版和印刷版的广告收入，2004年-2005年，单位：百万美元，较之去年同期的增长%

	印刷版	年%	在线版	年%
2005Q4	13,756	0.41%	552.211	32.50%
2005Q3	11,448.5	1.6%	518.975	26.7%
2005Q2	11,731.06	1.9%	500.716	28.6%
2005Q1	10,472.52	2.4%	454.62	39.7%
2004Q4	13,699.98	4.23%	416.76	24.00%
2004Q3	11,271.59	3.83%	409.71	23.40%
2004Q2	11,508.30	4.10%	389.42	32.10%
2004Q1	10,222.84	3.46%	325.39	28.30%

来源：NAA: Quarterly Newspaper Advertising Expenditures

显然，在线版报纸的广告收入增幅很高，但基数很小；印刷版报纸的广告收入增幅很低，且越来越低，但基数很大。假设在线报纸广告收入每年有33%的增幅，印刷报纸每年增幅为3%，那么直到2017年在线报纸依然赶不上印刷报纸的广告收入。旧媒体垂而不死，新媒体任重道远。

自1950年以来报纸广告收入的年度数据如下：

年度数据，美国报纸的广告收入，1950年-2005年，单位：百万美元，较之去年同期的增长%

Year	NATIONAL		RETAIL		CLASSIFIED		PRINT TOTAL		ONLINE TOTAL		PRINT AND ONLINE TOTAL
Year	$Mill	%Change	$Mill	%Change	$Mill	%Change	$Mill	%change	$Mill	%change	$Mill	%Change
1950	$518	11.90%	$1,175	6.30%	$377	9.90%	$2,070	8.30%
1951	$529	2.10%	$1,259	7.10%	$463	22.80%	$2,251	8.70%
1952	$537	1.50%	$1,411	12.10%	$516	11.40%	$2,464	9.50%
1953	$606	12.80%	$1,455	3.10%	$571	10.70%	$2,632	6.80%
1954	$607	0.20%	$1,539	5.80%	$539	-5.60%	$2,685	2.00%
1955	$712	17.30%	$1,755	14.00%	$610	13.20%	$3,077	14.60%
1956	$768	5.90%	$1,808	3.00%	$661	8.40%	$3,223	4.70%
1957	$738	0.80%	$1,835	1.50%	$665	0.60%	$3,268	1.40%
1958	$724	-4.70%	$1,802	-1.80%	$650	-2.30%	$3,176	-2.80%
1959	$774	6.90%	$2,014	11.80%	$738	13.50%	$3,526	11.00%
1960	$778	0.50%	$2,100	4.30%	$803	8.80%	$3,681	4.40%
1961	$744	-4.40%	$2,053	-2.20%	$804	0.10%	$3,601	-2.20%
1962	$722	-3.00%	$2,103	2.40%	$834	3.70%	$3,659	1.60%
1963	$702	-2.80%	$2,211	5.10%	$867	4.70%	$3,780	3.30%
1964	$773	10.10%	$2,344	6.00%	$1,003	15.70%	$4,120	9.00%
1965	$783	1.30%	$2,429	3.60%	$1,214	21.00%	$4,426	7.40%
1966	$887	13.30%	$2,645	8.90%	$1,333	9.80%	$4,865	9.90%
1967	$846	-4.60%	$2,760	4.30%	$1,304	-2.20%	$4,910	0.90%
1968	$889	5.10%	$2,919	5.80%	$1,424	9.20%	$5,232	6.60%
1969	$943	6.10%	$3,166	8.50%	$1,605	12.70%	$5,714	9.20%
1970	$891	-5.50%	$3,292	4.00%	$1,521	-5.20%	$5,704	-0.20%
1971	$972	9.10%	$3,565	8.30%	$1,630	7.20%	$6,167	8.10%
1972	$1,062	9.30%	$3,964	11.20%	$1,913	17.40%	$6,939	12.50%
1973	$1,049	-1.20%	$4,245	7.10%	$2,187	14.30%	$7,481	7.80%
1974	$1,105	5.30%	$4,563	7.50%	$2,174	-0.60%	$7,842	4.80%
1975	$1,109	0.40%	$4,966	8.80%	$2,159	-0.70%	$8,234	5.00%
1976	$1,342	21.00%	$5,668	14.10%	$2,608	20.80%	$9,618	16.80%
1977	$1,472	9.70%	$6,241	10.10%	$3,038	16.50%	$10,751	11.80%
1978	$1,541	4.70%	$7,023	12.50%	$3,649	20.10%	$12,213	13.60%
1979	$1,770	14.90%	$7,845	11.70%	$4,248	16.40%	$13,863	13.50%
1980	$1,963	10.90%	$8,609	9.70%	$4,222	-0.60%	$14,794	6.70%
1981	$2,258	15.00%	$9,686	12.50%	$4,583	8.60%	$16,527	11.70%
1982	$2,452	8.60%	$10,390	7.30%	$4,852	5.90%	$17,694	7.10%
1983	$2,734	11.50%	$11,841	14.00%	$6,006	23.80%	$20,581	16.30%
1984	$3,081	12.70%	$12,784	8.00%	$7,657	27.50%	$23,522	14.30%
1985	$3,352	8.80%	$13,443	5.20%	$8,375	9.40%	$25,170	7.00%
1986	$3,376	0.70%	$14,311	6.50%	$9,303	11.10%	$26,990	7.20%
1987	$3,494	3.50%	$15,227	6.40%	$10,691	14.90%	$29,412	9.00%
1988	$3,821	2.60%	$15,790	4.00%	$11,586	10.10%	$31,197	6.10%
1989	$3,948	3.30%	$16,504	4.50%	$11,916	2.90%	$32,368	3.80%
1990	$4,122	4.40%	$16,652	0.90%	$11,506	-3.50%	$32,280	-0.30%
1991	$3,924	-4.80%	$15,839	-4.90%	$10,587	-8.00%	$30,349	-6.00%
1992	$3,834	-2.30%	$16,041	1.30%	$10,764	1.70%	$30,639	1.00%
1993	$3,853	0.50%	$16,859	5.10%	$11,157	3.70%	$31,869	4.00%
1994	$4,149	7.70%	$17,496	3.80%	$12,464	11.70%	$34,109	7.00%
1995	$4,251	2.50%	$18,099	3.40%	$13,742	10.30%	$36,092	5.80%
1996	$4,667	9.80%	$18,344	1.40%	$15,065	9.60%	$38,075	5.50%
1997	$5,315	13.90%	$19,242	4.90%	$16,773	11.30%	$41,330	8.50%
1998	$5,721	7.70%	$20,331	5.70%	$17,873	6.60%	$43,925	6.30%
1999	$6,732	17.70%	$20,907	2.80%	$18,650	4.30%	$46,289	5.40%
2000	$7,653	13.70%	$21,409	2.40%	$19,608	5.10%	$48,670	5.10%
2001	$7,004	-8.50%	$20,679	-3.40%	$16,622	-15.20%	$44,305	-9.00%
2002	$7,210	2.90%	$20,994	1.50%	$15,898	-4.30%	$44,102	-0.50%
2003	$7,797	8.10%	$21,341	1.70%	$15,801	-0.60%	$44,939	1.90%	$1,216		$46,156
2004	$8,083	3.70%	$22,012	3.10%	$16,608	5.10%	$46,703	3.90%	$1,541	26.70%	$48,244	4.50%
2005	$7,910	-2.15%	$22,187	0.79%	$17,312	4.24%	$47,408	1.51%	$2,027	31.48%	$49,435	2.47%

来源：NAA: Annual Newspaper Ad Expenditures

22:29 图：Hansen, Idaho » laolu

17:30 hl_ftien_spider原来是海量的蜘蛛 » 车东[Blog^2]

最近很多站点都发现了一个名叫hl_ftien_spider的蜘蛛，这个蜘蛛的抓取频度：可是相当的厉害，几乎和DoS攻击差不多，自然也引起了不少公愤：

今天网站流量再度攀升,经检查原来是一个名为"hl_ftien_spider"的蜘蛛在疯狂的爬我的网站网页.

grep hl_ftien_spider access_log.20060304 |awk '{print $1 $2 $4 $3 $12}'

218.68.240.81-[04/Mar/2006:22:57:11-"hl_ftien_spider"
218.68.240.81-[04/Mar/2006:22:57:27-"hl_ftien_spider"
218.68.240.81-[04/Mar/2006:22:57:28-"hl_ftien_spider"
218.68.240.81-[04/Mar/2006:22:57:28-"hl_ftien_spider"
218.68.240.81-[04/Mar/2006:22:57:45-"hl_ftien_spider"
218.68.240.81-[04/Mar/2006:22:57:46-"hl_ftien_spider"

................

这样胡乱爬网页跟攻击没有什么区别,马上封了该ip地址,iptables在封锁ip上还是非常有效的:

iptables -A INPUT -s 218.68.240.38 -j REJECT 

查询了一下该Ip地址,是来自天津的:

您要查询的是"218.68.240.38"，它被理解为"218.68.240.38"

官方数据:
在亚洲与太平洋网络信息中心(APNIC)找到:

% [whois.apnic.net node-1]
% Whois data copyright terms    http://www.apnic.net/db/dbcopyright.html

路由:                   218.68.0.0/15
单位全名和地址:         CNC Group CHINA169 Tianjin Province Network
国家或地区:             中国
自治域(AS):             AS4837
维护者:                 MAINT-CNCGROUP-RR
变更记录:               abuse@cnc-noc.net 20060118
信息来源:               APNIC 

谁知道这是哪家的蜘蛛出来乱爬么?

Google上也没有有用的信息,似乎是流氓引擎吧.

看看WebMasterWorld上的评论：

 This bot hit my site today, picked up robots.txt, then picked up a few dozen pages - and tried to pick up about 1800 more pages after it hit a bot trap.

All of which it did within 4 minutes.

The IP is the same as you had, and it resolves to net263.com in China.
I've banned it.

我今天从服务器的突然后台负载增高也发现了这个蜘蛛，上月的一次大量抓取来自上海某高校，当时不得不将我的twiki改成了认证登录。

60.28.249.27 - - [31/Mar/2006:17:32:42 +0800] "GET /phpMan.php/man/nl/3ncurses HTTP/1.1" 200 10235 "http://www.chedong.com/phpMan.php/man/output./1" "hl_ftien_spider" 60.28.249.27.38631143794139731
60.28.249.27 - - [31/Mar/2006:17:32:42 +0800] "GET /phpMan.php/man/printw/3ncurses HTTP/1.1" 200 4939 "http://www.chedong.com/phpMan.php/man/output./1" "hl_ftien_spider" 60.28.249.27.38631143794139731
60.28.249.27 - - [31/Mar/2006:17:32:42 +0800] "GET /phpMan.php/man/curl_mvsnprintf/3 HTTP/1.1" 200 6830 "http://www.chedong.com/phpMan.php/man/output./1" "hl_ftien_spider" 60.28.249.27.38631143794139731
60.28.249.27 - - [31/Mar/2006:17:32:42 +0800] "GET /phpMan.php/man/HTML::Element/3pm HTTP/1.1" 200 61844 "http://www.chedong.com/phpMan.php/man/class/1" "hl_ftien_spider" 60.28.249.27.38631143794139731
60.28.249.27 - - [31/Mar/2006:17:32:43 +0800] "GET /phpMan.php/man/vw_printw/3ncurses HTTP/1.1" 200 4948 "http://www.chedong.com/phpMan.php/man/output./1" "hl_ftien_spider" 60.28.249.27.38631143794139731
60.28.249.27 - - [31/Mar/2006:17:32:43 +0800] "GET /phpMan.php/man/vprintf/3 HTTP/1.1" 200 30165 "http://www.chedong.com/phpMan.php/man/output./1" "hl_ftien_spider" 60.28.249.27.38631143794139731
60.28.249.27 - - [31/Mar/2006:17:32:43 +0800] "GET /phpMan.php/man/yes/1 HTTP/1.1" 200 3301 "http://www.chedong.com/phpMan.php/man/output./1" "hl_ftien_spider" 60.28.249.27.38631143794139731
60.28.249.27 - - [31/Mar/2006:17:32:44 +0800] "GET /phpMan.php/man/snprintf/3 HTTP/1.1" 200 30168 "http://www.chedong.com/phpMan.php/man/output./1" "hl_ftien_spider" 60.28.249.27.38631143794139731
60.28.249.27 - - [31/Mar/2006:17:32:45 +0800] "GET /phpMan.php/man/vfprintf/3 HTTP/1.1" 200 30168 "http://www.chedong.com/phpMan.php/man/output./1" "hl_ftien_spider" 60.28.249.27.38631143794139731
60.28.249.27 - - [31/Mar/2006:17:32:45 +0800] "GET /phpMan.php/man/scrollok/3ncurses HTTP/1.1" 200 10253 "http://www.chedong.com/phpMan.php/man/output./1" "hl_ftien_spider" 60.28.249.27.38631143794139731

网站稍微差一点的都会承受不住压力的。我今天顺着来源的IP地址看了一下，http://60.28.249.27/ 这不是海量的DIGDIG搜索引擎的论坛吗？

15:57 The Alternative Chinese Dictionary » English - The Real Deal

This is pure comedy gold: The Alternative Chinese Dictionary (Warning: Foul/offensive language aplenty! Definitely not for minors.) I laughed out loud at this one: ji1 ba (noun) Often used as a pure expletive in sentence: Che3 ji1 ba dan4 (= Bullshit). My questions: 1) Shouldn’t “chou1 ni3 ma1 de bi1″ be “cao4 ni3 ma1 de bi1″? 2) nu [...]

14:09 Google updates homepage content page » Googling Google

Google has updated their Personalized Homepage content chooser with a new look. The little blue box at the top of your personalized hompage is no longer there -- it is replaced by a simple text link that takes you to a new content chooser.This page separates modules into categories so you can find what you [...]

11:08 do you have anything to declare? » del.icio.us

We’ve just rolled out our import tool. You can now import your existing bookmarks from Firefox, IE, Safari, Opera, or anything that supports the traditional Netscape bookmark file format. If you like, we can even give you a bit of...

11:07 Iozone Filesystem Benchmark » del.icio.us/chedong

Ozone is a filesystem benchmark tool. The benchmark generates and measures a variety of file operations. Iozone has been ported to many machines and runs under many operating systems.

10:54 CTR now shows two decimal places in AdSense » JenSense - Making Sense of Contextual Advertising

A fairly minor change, but AdSense changed the control panel today to display CTR to two decimal places instead of the previous format of just one decimal place. This means instead of 15.8% for your CTR you would see 15.82%,...

10:26 Yahoo!為IE設計的Tab Browsing » Jan's Tech Blog

Yahoo!推出新Toolbar。最大的賣點吸引Jan的試的，就是它可為IE加入Tab Browsing功能。於是就安裝一下試試。安裝了Yahoo! Toolbar之後，IE就即時多了Tab介面，而在第一個Tab的旁邊就有「+Add Tab」鍵，讓我們打開空白的Tab。而在IE的Contextual也多了「Open this link in a new tab」。操作尚算易吧。...

09:37 在三台的新相片，在三台的旧邮件 » 大学小容

Tags=santai,xiaorong,supergirl,openletter

时间很快，小容来三台已经第三周了。小容很习惯这里，感觉像是回到了家乡建阳。工作还和在福州的时候一样忙，打开电脑Gmail、Skype、MSN还是原来的联系人：）因为离办公室很近，节省出了一些时间来休息和复习英语。工作时间从周一排到周六，前两周的时候基本上从早上9：00工作到晚上10：00，有时候更迟，这周晚上的情况好了一些。

周日的时候安排一天休息，小容会出去四处走走，拍一些相片，第一周的时候和同事去了县城里的凤凰山和钓鱼，第二周（上一周）的时候自己去拍了这里的两条江，因为油菜花正开，就要过了花季。

新相片：凤凰山上的茶楼

茶楼一角。

“上山”在这里是休闲的代名词。

旧邮件：并非人心险恶

贴出去年来三台的时候和朋友通讯的邮件。有个朋友是李宇春的Fans，她来信说到她狂喜欢李宇春却得不到周边朋友的理解，而且还被有些人误解，于是感到世界有些“人心险恶”，小容的回信如下：

09:24 下一版酷讯会是什么样子呢？ » 酷讯黑板报

现在的酷讯有一些很好的概念，但是用户对我们的界面却很有意见。这也难怪，谁叫酷讯的UI是我这个写程序的人设计的呢。好在公司成立之后，我们有了更多的资源，也重新考虑了一下酷讯的定位与用户体验。现在有一个新的UI设计，就是把酷讯定位成专业的信息搜索引擎，并把栏目整理成频道。大家看看这个设计给一点意见吧 Tony

08:59 George Mason Fact Guide » The Ask.com Blog

Facts:* George Mason is the first 11 seed to make the Final Four since LSU in 1986 and the first non-BCS team to make it since Penn and Indiana State in 1979. * Is just the second double-digit seed...

08:01 Google历史上的4月1日玩笑 » Blog on 27th Floor

2000年，MentalPlex™，只要你去掉帽子和眼镜，盯着屏幕上一个螺旋看，然后想一下要搜的东西，最后点那个螺旋，就能看到结果。

2001年，没有。

2002年，PigeonRank™，这是一种依靠鸽子来对网页进行排序的专利技术，这些鸽子很好训练，又有很强的对比两页之间差别的能力，然后就可以组成鸽子集群，对互联网上的页面进行排序。

2003年，没有。当时甚至有人开始说Google开始不酷了吗？也有人说是因为Google要IPO了。

2004年，Lunar Jobs，Google要在月球上开设一个研究中心，正在面试，欢迎应聘。

2005年，Google Gulp(Beta)™，这是一种可以让饮用者更聪明的饮料，喝了它可以有更好的浏览体验，能搜到更好的网页。与此饮料相配还有Auto Drink技术，如果不想自动喝，可以关闭此功能。

2006年，Google会向全球派出自己的搜索机器人吗？会把主页换成定制主页吗？会在火星上打出Google的标志吗？会搜出外星人存在的证据吗？

当然，2004年的4月1日Google在搞笑的同时也推出了容量和影响都很是巨大的Gmail，当时Hotmail只有2MB，Yahoo只有10MB，大批的国内信箱正在收钱；所以也说不好这次Google一样会发布些新东西，比如Calendar，Show一下Goobuntu之类的，或者给Gmail摘掉Beta的帽子等等。

Any way, KEEP COOL.

08:00 2006/03/31 08:00:00TQ洽谈通搜索力指数排行榜 » TQ洽谈通搜索力指数

搜索引擎	搜索力指数	排名升降	份额
1. Baidu	151578050		61.14%
2. Google	29292758		11.82%
3. 3721	26762730		10.80%
4. Yahoo	24194110		9.76%
5. Zhongsou	7316434		2.95%
6. Sogou	4820710		1.94%
7. iAsk	1102906		0.44%
8. 163	1098510		0.44%
9. China	888290		0.36%
10. QQ	493686		0.20%
11. Tom	356362		0.14%

06:11 TechnoServe update: New program in Ghana » Official Google Blog

Posted by Nick Railston-Brown, Ghana Country Director, TechnoServe

The Google Foundation supports select organizations whose work addresses the challenge of global poverty in ways that are effective, sustainable, and scalable. From time to time we invite guest bloggers from grantee organizations to tell us about their work.

We’re pleased to report that TechnoServe and the Google Foundation are launching a national business plan competition this week in Ghana, called “Believe Begin Become.” It’s designed to help Ghanaian entrepreneurs develop skills, obtain seed or expansion capital and establish the networks that help transform their business ideas into successful enterprises.

More and more, entrepreneurs are recognizing the value of gaining skills, tools and a strong business network, and we know from our experience in Latin America what this kind of competition can mean to entrepreneurs. The program helps establish a crucial business network that will carry on long after the competition ends.

Our Organizing Committee colleague Ishmael Yamson puts it this way: “There are many entrepreneurs out there with good ideas — but they need encouragement to translate those ideas into concrete activities. Believe Begin Become can help them to do that.”

Get in touch if you’d like to get involved.

01:59 Another Adam Bosworth sighting » Googling Google

Dirson.com reports another Adam Bosworth sighting with the title "Architect, Google Health" -- just like the one found in the attendee list of PC forum. This time he is slated to be a featured speaker at DISA Customer Partnership Conference 2006 on May 4.For those who don't know, DISA is "The Defense Information Systems Agency [...]