python爬虫分析利器,pyquery
https://pypi.python.org/pypi/pyquery
Quickstart
You can use the PyQuery class to load an xml document from a string, a lxml document, from a file or from an url:
>>> from pyquery import PyQuery as pq >>> from lxml import etree >>> import urllib >>> d = pq("<html></html>") >>> d = pq(etree.fromstring("<html></html>")) >>> d = pq(url='http://google.com/') >>> # d = pq(url='http://google.com/', opener=lambda url, **kw: urllib.urlopen(url).read()) >>> d = pq(filename=path_to_html_file)
Now d is like the $ in jquery:
>>> d("#hello") [<p#hello.hello>] >>> p = d("#hello") >>> print(p.html()) Hello world ! >>> p.html("you know <a href='http://python.org/'>Python</a> rocks") [<p#hello.hello>] >>> print(p.html()) you know <a href="http://python.org/">Python</a> rocks >>> print(p.text()) you know Python rocks
You can use some of the pseudo classes that are available in jQuery but that are not standard in css such as :first :last :even :odd :eq :lt :gt :checked :selected :file:
>>> d('p:first') [<p#hello.hello>]
See http://packages.python.org/pyquery/ for the full documentation