Comments on: Pywebkitgtk – execute Javascript from python

By: Tudor

Tudor — Tue, 10 Jan 2012 11:48:41 +0000

Sourabh Singi> Can you please give more details on what distribution you are using?

By: Tudor

Tudor — Tue, 10 Jan 2012 11:45:40 +0000

There’s a problem with the indentation when you pasted the code. Just re-indent everything using either tabs either spaces, no combinations of the two.

By: Ignacio

Ignacio — Mon, 09 Jan 2012 23:29:27 +0000

hi.
I have copy and paste your code, but
I don’t know why:

>>> def crawl(self):
  File "", line 1
    def crawl(self):
    ^
IndentationError: unexpected indent
>>> view = WebView()
  File "", line 1
    view = WebView()
    ^
IndentationError: unexpected indent
>>> view.open(self._url)
  File "", line 1
    view.open(self._url)
    ^
IndentationError: unexpected indent
...

By: Sourabh Singi

Sourabh Singi — Wed, 04 Jan 2012 06:40:49 +0000

I have a problem installing the python-webkitgtk, I googled for the solution, but cudnt find much help.

$ sudo apt-get install python-webkitgtk libwebkit-1.0-1 libwebkit-dev
Reading package lists... Done
Building dependency tree
Reading state information... Done
E: Couldn't find package python-webkitgtk

Anyone who have faced the same problem and solved it?

By: Passerby

Passerby — Fri, 29 Jul 2011 13:02:47 +0000

Hi,

Using selenium can be a solution as well

By: Sérgio Basto

Sérgio Basto — Mon, 16 May 2011 18:11:36 +0000

replace
gtk.gdk.threads_init()
to
import gobject
gobject.threads_init()

works even better

By: Ajijor

Ajijor — Tue, 22 Mar 2011 12:11:13 +0000

Thanks !
This is wicked.

Interestingly, I get an exception for the import of threads.
I am on Ubuntu10.10 with Python 2.6.6.
I removed the import and stuff seems to be working ….

By: Jason

Jason — Wed, 05 Jan 2011 04:57:17 +0000

It’d be great if anyone could write a Scrapy extension for this.

By: ryan

ryan — Mon, 19 Jul 2010 08:32:39 +0000

it seems the code ‘s execution has nothing to do with python-webkitgtk, as I had not install it, but the code above can and do the work correctly~~

By: BrochesterL

BrochesterL — Sun, 02 May 2010 20:38:17 +0000

Definitely Use the main_resource from the main frame as you will see in the python api for webkit it is what holds on to the bulk from all the ajax type stuff running, only problem is I havent been able to render javascript and “dump” (as it were), an entire page from this api, It needs some rethinking to be a true crawler.
but here is what is required to view your gmail inbox in pywebkitgtk,
if you run the pywebkit browser demo

 >>> webkit.browser.get_children()[0].get_children()[1].get_children()[TabNumber].get_children()[0].get_main_frame().get_data_source().get_data()

when in your gmail inbox will dump all your mail from lists in javascript source
Now If I could Just get the links extracted so I can navigate and recursively download my mail. Only because current provider blocks all SMTP.!!!