Comments on: Downloading a page’s content with python and WebKit http://blog.motane.lu/2009/07/07/downloading-a-pages-content-with-python-and-webkit/ Ramblings about software development Thu, 02 Feb 2012 17:38:29 +0000 hourly 1 http://wordpress.org/?v=3.3.1 By: Scraping AJAX web pages (Part 2) « The Ubuntu Incident http://blog.motane.lu/2009/07/07/downloading-a-pages-content-with-python-and-webkit/comment-page-1/#comment-2613 Scraping AJAX web pages (Part 2) « The Ubuntu Incident Tue, 20 Sep 2011 20:07:15 +0000 http://blog.motane.lu/?p=896#comment-2613 [...] Downloading a page’s content with python and WebKit :: Downloading a page’s content afte... [...] [...] Downloading a page’s content with python and WebKit :: Downloading a page’s content afte… [...]

]]> By: trash80 http://blog.motane.lu/2009/07/07/downloading-a-pages-content-with-python-and-webkit/comment-page-1/#comment-2593 trash80 Thu, 08 Sep 2011 02:19:49 +0000 http://blog.motane.lu/?p=896#comment-2593 @Suncokret - the package is 'python-webkit', which is pywebkitgtk. So much for meaningful names. @Suncokret – the package is ‘python-webkit’, which is pywebkitgtk. So much for meaningful names.

]]> By: philips http://blog.motane.lu/2009/07/07/downloading-a-pages-content-with-python-and-webkit/comment-page-1/#comment-2547 philips Tue, 21 Jun 2011 12:28:20 +0000 http://blog.motane.lu/?p=896#comment-2547 I make a <a href="http://www.fminer.com" rel="nofollow">web scraping tool</a> using webkit and Pyside, help can help others. I make a web scraping tool using webkit and Pyside, help can help others.

]]> By: Suncokret http://blog.motane.lu/2009/07/07/downloading-a-pages-content-with-python-and-webkit/comment-page-1/#comment-2544 Suncokret Tue, 21 Jun 2011 00:59:08 +0000 http://blog.motane.lu/?p=896#comment-2544 Tried those two expamles but with no luck. On Ubuntu 11.04 this link helped me http://github.com/emyller/webkitcrawler but explanations from Tudor were excelent. Ubuntu python-webkitgtk ... can not be found in 11.04 repository. Thanks Tried those two expamles but with no luck.

On Ubuntu 11.04 this link helped me http://github.com/emyller/webkitcrawler but explanations from Tudor were excelent.

Ubuntu python-webkitgtk … can not be found in 11.04 repository.

Thanks

]]> By: neumino » Blog Archive » Parallel crawling and javascript http://blog.motane.lu/2009/07/07/downloading-a-pages-content-with-python-and-webkit/comment-page-1/#comment-2277 neumino » Blog Archive » Parallel crawling and javascript Sun, 08 May 2011 16:50:02 +0000 http://blog.motane.lu/?p=896#comment-2277 [...] using things like wget or curl was out of question. I eventually find a nice way to do things here. The last thing that I needed was to parallelize it (the webpages were quite [...] [...] using things like wget or curl was out of question. I eventually find a nice way to do things here. The last thing that I needed was to parallelize it (the webpages were quite [...]

]]> By: Tudor http://blog.motane.lu/2009/07/07/downloading-a-pages-content-with-python-and-webkit/comment-page-1/#comment-1960 Tudor Wed, 26 Jan 2011 11:00:47 +0000 http://blog.motane.lu/?p=896#comment-1960 I don't have access to a windows machine, so I can't help you... I don’t have access to a windows machine, so I can’t help you…

]]> By: Sina http://blog.motane.lu/2009/07/07/downloading-a-pages-content-with-python-and-webkit/comment-page-1/#comment-1957 Sina Wed, 26 Jan 2011 01:53:50 +0000 http://blog.motane.lu/?p=896#comment-1957 I used the exact same code on Windows. But the output file still have all the original java scripts! Do you guys have any idea why? I used the exact same code on Windows. But the output file still have all the original java scripts! Do you guys have any idea why?

]]> By: Tudor http://blog.motane.lu/2009/07/07/downloading-a-pages-content-with-python-and-webkit/comment-page-1/#comment-1635 Tudor Tue, 21 Dec 2010 07:16:04 +0000 http://blog.motane.lu/?p=896#comment-1635 Install Xvfb! Install Xvfb!

]]> By: Antonio http://blog.motane.lu/2009/07/07/downloading-a-pages-content-with-python-and-webkit/comment-page-1/#comment-1630 Antonio Sun, 19 Dec 2010 22:46:55 +0000 http://blog.motane.lu/?p=896#comment-1630 Hi, got this error cannot connect to X server Wasn't one of the requirements that the script run without X? Thanks Hi, got this error
cannot connect to X server
Wasn’t one of the requirements that the script run without X?
Thanks

]]> By: wxuan http://blog.motane.lu/2009/07/07/downloading-a-pages-content-with-python-and-webkit/comment-page-1/#comment-1575 wxuan Mon, 06 Dec 2010 03:05:18 +0000 http://blog.motane.lu/?p=896#comment-1575 I use your script to crawl the web page on windows, but the Chinese characters are garbled. Can you give me some advices to fix this problem? Thank you! I use your script to crawl the web page on windows, but the Chinese characters are garbled. Can you give me some advices to fix this problem? Thank you!

]]>