[英]How can I parse dynamic content from a web page?
I try to get a proxy list from this url: 我尝试从这个网址获取代理列表:
This would be cool, but port number is dynamic JavaScript content. 这很酷,但端口号是动态JavaScript内容。 How can I get JavaScript-generated content from this page? 如何从此页面获取JavaScript生成的内容? I have jsoup and djNativeSwing but I want do this in background thread. 我有jsoup和djNativeSwing,但我想在后台线程中执行此操作。
JWebBrowser webBrowser = new JWebBrowser();
webBrowser.navigate("http://spys.ru/en/free-proxy-list/");
System.out.println(webBrowser.getHTMLContent());
this code returns a Null result. 此代码返回Null结果。 Help please. 请帮助。
The webbrowser hasn't finnished loading when you call the getHtmlContent() method. 调用getHtmlContent()方法时,webbrowser没有完成加载。 Use something like this instead: 使用这样的东西代替:
JWebBrowser webBrowser = new JWebBrowser();
webBrowser.navigate("http://spys.ru/en/free-proxy-list/");
webBrowser.addWebBrowserListener(new WebBrowserListener(){
public void loadingProgressChanged(WebBrowserEvent e){
if(e.getWebBrowser().getLoadingProgress()==100)
System.out.println(webBrowser.getHTMLContent());
}
}
/* Note: I wrote this in the comment field without any testing,
you probably have to make the webBrowser final. */
声明:本站的技术帖子网页,遵循CC BY-SA 4.0协议,如果您需要转载,请注明本站网址或者原文地址。任何问题请咨询:yoyou2525@163.com.