常识。
空气污染这个事情现在被闹得这么大，其实比较可笑。。。
非得要出个什么软件或者机构发布一个数据出来，大家才会去关注一下。。。

科普常识这个事情实在是个长久的大工程啊。。。
捎带推荐一本书：健康流言终结者 松鼠会的医学博士 “薄三郎” 所写。
上帝保佑呼吸了帝都毒气的苦逼人民。

代码。
先看这篇：《先要好代码？ 还是好产品？》。
少一些技术思维，多一些产品思路。
代码是为了产品服务的。最终–是为了服务生活。

生活。
微博上有一段时间总是有一些人在转发“炫耀”加班。但是。。。真的需要这样吗？
如何高效有效的做事才是值得思考的。去看看Get thing Real & Rework吧。
工作是为生活服务的。

游戏。
浑水上海中转站：中国“隐形人”的蓝海生意
I love this game.

http://sudone.com/linux/squid_privoxy_tor.html

2、利用redsocks(http://darkk.net.ru/redsocks/)来转发，相关链接：
Setup iptables for RedSocks in OpenWRT : https://gist.github.com/1097210/796886ba50978ca2426d7bedafd61076858b2c64

http://www.right.com.cn/forum/viewthread.php?action=printable&tid=40111

http://bjin.posterous.com/redsocks-on-android

http://shell909090.com/blog/ (这里有一些openwrt相关的东东)

http://blog.zhuli.name/archives/6690

http://www.wy182000.info/2011/08/05/socks%E4%BB%A3%E7%90%86%E7%9A%84%E9%80%8F%E6%98%8E%E5%8C%96%E5%92%8C%E5%8F%AF%E8%B7%AF%E7%94%B1/

==openwrt相关==

http://shell909090.com/blog/2011/09/%E5%90%88%E7%94%A8%E4%B8%A4%E4%B8%AA%E8%B7%AF%E7%94%B1%E5%99%A8%E7%9A%84%E5%87%A0%E7%A7%8D%E6%96%B9%E6%A1%88/

http://penglei.name/html/100.html (tomato配置VLAN)

其他参考资料:

Linux上iptables防火墙的基本应用教程

http://www.vpser.net/security/linux-iptables.html

单网卡Linux利用iptables做网关

http://linux.chinaunix.net/techdoc/net/2007/05/08/957205.shtml

Linux下使用单网卡实现nat共享上网

http://zhangruirong.blog.51cto.com/2098188/386947

Linux单网卡实现NAT路由

http://gsion.blog.163.com/blog/static/123056504201162111957875/

單網卡red hat 7.2 linux利用iptables作為簡單網關的配置

http://fanqiang.chinaunix.net/a1/b1/20020815/060200294_b.html

http://www.zoopda.com/forum.php?mod=viewthread&tid=45662

Request: Headless HTML rendering engine?

Written by Adrian Holovaty on May 2, 2008

Warning: Seriously geeky request ahead!

I’m looking for a way to render arbitrary Web pages — including CSS and JavaScript — and access the resulting DOM tree programatically, i.e., in an automated/headless fashion. I want to be able to ask the following questions of the resulting DOM tree:

For a given element, what font family, size, and color is the text?
How tall and wide (in pixels) is a given

,
, etc.? What are the x/y coordinates of a given element (from the upper-left corner of the page, or lower-left, or wherever)? For a given element, what is its text content?

The rendering must be state-of-the-art, handling advanced CSS that Firefox, Safari and IE handle. It should work on Linux. Bonus points if there’s a Python API for this magical DOM tree.

This is all stuff that standard in-page JavaScript could accomplish, but the catch with me is that I need to be able to do it in a completely automated way, on arbitrary pages, on a headless server.

I know Gecko and Webkit provide this, but I’m not sure where to start with them. The docs and articles I’ve read seem to be focused more on embedding the full browser window in a GUI application than embedding the rendering engine itself and manipulating the resulting pages.

Help! If you have any clues, I’d be grateful if you left a comment or got in touch with me.
Comments
Posted by Andrew Sutherland on May 2, 2008 at 2:45 a.m.:

PyXPCOM (http://developer.mozilla.org/en/docs/PyXPCOM) should handle the Python part of the Gecko equation.

I myself am no specific help on the gecko side of things, but I think the following post/thread on the PyXPCOM mailing list may be of assistance:

http://aspn.activestate.com/ASPN/Mail/Message/pyxpcom/3619998

Posted by Rene Dudfield on May 2, 2008 at 3:19 a.m.:

You can set up a headless X server, then run firefox, or whatever browser with a standard build.
Posted by Michael Twomey on May 2, 2008 at 4:46 a.m.:

If you want an example of using webkit to do headless stuff you could look at webkit2png which is a tool for taking screenshots of websites from command line. It uses webkit and pyobjc, so you’ll need a mac. It doesn’t do any DOM stuff that I can see but I might be a useful starting point for writing an automated tool.
Posted by Justin Mason on May 2, 2008 at 5:01 a.m.:

http://khtml2png.sourceforge.net/ might be useful, if you’re doing this on a *NIX platform. Looks like it’s well-maintained, too, since the most recent release was only a couple of weeks ago.
Posted by Gábor Farkas on May 2, 2008 at 5:10 a.m.:

in case of firefox, there are 2 issues:

1. run it somehow in a headless mode: for this, try Xvfb. it starts a headless X server. then you can run firefox in it.

2. communicate with the firefox instance. there is PyXPCOM, as others already mentioned, which could make it work.
Posted by Jason on May 2, 2008 at 7:04 a.m.:

If you want to muck in C++ code you could look at RenderTreeAsText in Webkit. For actually setting up the rendering engine, there’s some relatively simple high-level apis in the wx and qt ports that seem pretty readable; the kind of api you’d use for those neat “write a web browser in 5 lines of code” demos. See WebFrame in particular. Disclaimer: I’ve never written anything with webkit, but it might be fun to learn.
Posted by anonymous on May 2, 2008 at 8:15 a.m.:

What about Selenium? or Watir?
Posted by anonymous on May 2, 2008 at 8:50 a.m.:

I haven’t tried this (but am planning to), so I don’t know if it really meets your needs, but HTMLUnit is a Java-based headless browser (designed for testing).
Posted by anonymous on May 2, 2008 at 10:15 a.m.:

Attributes such as pixel width, height, font etc will either be determined by CSS, or they will be agent (and user setup) specific.

The pixel width of a div of width 50% will depend on the size of the viewport – which of course would be anything. Do you intend to ‘fake’ the settings of a user agent? If so, then a simple calculation would get the pixel width (as you would know your viewport dimensions).

I really would consider seeing how far you can get by simply manipulating the dom and parsing the css (both of which are easily achieved with the python libraries urllib, lxml / beautifulsoup and cssutils).

I know, I know; None of this helps with javascript dependent attributes.

RC
Posted by alan taylor on May 2, 2008 at 10:36 a.m.:

Have you looked at JSSh? Not sure if it fits the bill, but it just might – it’s a “Mozilla C++ extension module that allows other programs (such as telnet) to establish JavaScript shell connections to a running Mozilla process via TCP/IP” I know it can return some parts of the DOM, but not sure how much detailed info you can get beack from it. http://www.croczilla.com/jssh
Posted by Matthew Marshall on May 2, 2008 at 10:42 a.m.:

I’ve played with doing this a little. The best I came up with was using PyKDE and khtml. I’m pretty sure it requires an X server, but if nothing else you could use a vnc server.

MWM
Posted by Kumar McMillan on May 2, 2008 at 11:40 a.m.:

There are probably several ways to do it, but the first that comes to mind is using the Python driver for Selenium RC …

from selenium import selenium

# with the selenium-rc (Java) proxy sever running at localhost:4444 …

selenium = selenium(“localhost”, 4444, “*firefox”, “http://thewebsite.com”)

selenium.open(“/”)

selenium.wait_for_page_to_load(’30000′)

selenium.get_html_source() # this is includes any JavaScript DOM manipulations, of course

selenium.get_element_position_left(“xpath=//div[1]“)

selenium.get_element_position_top(“xpath=//div[1]“)

selenium.get_element_height(“xpath=//table[1]“)

selenium.capture_screenshot(‘/tmp/site.png’)

… but I’m not sure how you get the font/text info. Selenium RC is designed to run headless and also has a “grid” implementation so you can throw more hardware at it. Scaling up to the grid is very transparent — same code as above, more or less.

Links:

http://selenium-rc.openqa.org/

http://selenium-rc.openqa.org/python.html

http://selenium-grid.openqa.org/

Posted by anonymous on May 2, 2008 at 12:02 p.m.:

seconding the jssh suggestion http://www.urbanhonking.com/ideasfordozens/archives/2008/03/automating_fire.html
Posted by Ryan Shaw on May 2, 2008 at 12:26 p.m.:

You might want to check out Crowbar:

Crowbar is a web scraping environment based on the use of a server-side headless mozilla-based browser. Its purpose is to allow running javascript scrapers against a DOM to automate web sites scraping but avoiding all the syntax normalization issues.
Posted by mikeal on May 2, 2008 at 1:49 p.m.:

I would go with windmill over Selenium if you’re going down that road. We have far more comprehensive javascript support, you can use execJS to get back the result of any arbitrary js.

http://windmill.osafoundation.org

And jssh is great, but MozRepl is jssh on crack.

http://hyperstruct.net/projects/mozrepl

The whole interface is much much nicer and I’m in the middle of a Python JavaScript bridge using MozRepl that I’ll be sure to send you a link to once it’s public.
Posted by Henning on May 2, 2008 at 2:29 p.m.:

Qt 4.4 is available on all platforms and contains a WebKit port. Fortunately the newest PyQt snapshots also contain support for WebKit. Because Qt can render every widget to a pixmap, is should be fairly easy. To run Qt headless you could use xvfb.

To access the DOM you can query with Javascript.

The following is _not_ tested:

from PyQt4.QtCore import *

from PyQt4.QtGui import *

from PyQt4.QtWebKit import *

import sys

app = QApplication(sys.argv)

browser = QWebView()

browser.show()

browser.resize(800,600)

#browser.setHtml(“Hello, world”)

browser.load(“http:///www.djangoproject.com”)

pm = QPixmap.grabWidget(browser)

pm.save(“website.jpg”)

body = browser().page().mainFrame().evaluateJavaScript(“getElementByName(‘body’)”)
Posted by anonymous on May 2, 2008 at 6:08 p.m.:

HTMLUnit is a very good headless browswer implementation. It supports different browsers and Jacascript (using Rhino I think). And finally, is under active development.

http://htmlunit.sourceforge.net/

Unfortuantely, its a Java library but you could use jpython to access it.
Posted by anonymous on May 2, 2008 at 6:12 p.m.:

I looked at a few open source projects to do headless rendering.

It’s tempting to use firefox/gecko but the learning curve is steep,

it’s 2 mln lines of netscape legacy C++ code.

But if you figure it out you’ll have a fine tool.

What is working for me now is lobo renderer (from cobra browser) (in java).

It’s not the best rendering engine, but it’s decent, and easy to program.

You can get rendered blocks and dom objects, and answer all the questions

as to block location, color, text etc.

It can be made to work on linux completely headless without an x server,

the way I have it working is it takes in a url or html, and saves to another

textual file format. What’s important is to encapsulate your choice

of rendering engine, because it will change.

Email me at dmitrim at yahoo dot com if you need help.
Posted by Phil on May 2, 2008 at 7:31 p.m.:

Personally I’d try it with MozRepl and an X virtual framebuffer: http://emacspeak.blogspot.com/2007/06/firebox-put-fox-in-box.html
Posted by Daniel on May 2, 2008 at 7:46 p.m.:

As suggested above, run firefox on a virtual X server. Use a firefox extension (mozrepl or jssh) to get automated control over the browser.

I set up a system doing exactly this (for taking screenshots) last summer. In the end it barely took any code, just a fair amount of faffing with config files. Happy to give more details if it’s helpful: (my first name) at ohuiginn.net
Posted by rex on May 3, 2008 at 8:44 a.m.:

I went throught trying to work out a way to do this ages ago.

Not sure if you’re feeling the same, Adrian, but what bothered me (purely from a principle level) was that I really wanted to be able to do this on my server _without_ having to run a headless X server, or an instance of firefox or whatever.. i wanted a library that was able to do it.. and give back my responses without having the uneccessary overhead of a browser, x server etc running (i know very little about it… but i can’t help but feel that these are uneccessary elements in the equation).

Surely there is a way to do what you’re asking without having a program running that is designed to actually render the pictures on a screen… *shrug*
Posted by anonymous on May 5, 2008 at 4:55 a.m.:

rex: Rendering HTML nowadays is a heavy complex task. So there is no light library, unfortunately. It sounds like using PyQt is the smartest approach because it does not load a full appliaction but only a rendering engine you can fully control. Having a dummy X-server on Unix seems to be a necessary evil.
Posted by Eric Moritz on May 5, 2008 at 3:50 p.m.:

I was thinking of this very issue a while back:

http://eric.themoritzfamily.com/2008/02/08/python-interface-mozilla-dom/

I came across this guy’s post:

http://ejohn.org/blog/bringing-the-browser-to-the-server/

He’s using Rhino and some custom javascript to emulate the browser’s window object.
Posted by John Herren on May 13, 2008 at 1:20 a.m.:

Rhino ftw

事情在一直往前推动。

Posted with WordPress for BlackBerry.

查看了一下iciba的“抑郁”翻译：depressed; despondent; gloomy。

depressed ：
adj.
1. 精神不振的,忧伤的,消沉的2. 患抑郁症的3. 经济萧条的,不景气的4. (中间部分)凹下的5. 低于一般水准的；降低了的；削弱了的

despondent
adj.
1. 沮丧的,泄气的

gloomy
adj.
1. 黑暗的, 阴暗的2. 令人沮丧的, 令人失望的3. 前景黯淡的；悲观的

不过这三个更多是书面语的意味。

unhappy 之于抑郁，字面解释很简单：“不快乐”。

所以，快乐才是好的。。。

参考链接：http://www.thefreedictionary.com/unhappy

==纯解释性文字，不说明个人的心理状态==

定个目标吧，考个雅思？嗯，可以！