简体   繁体   English

用jSoup解析网站

[英]Parse a website with jSoup

I am trying to parse a website, specifically this one It does not provide a api for that, like it does for bf4 or other titles, but the owner said that I should just parse the data. 我正在尝试解析一个网站,特别是这个网站。它没有为此提供api,就像bf4或其他标题一样,但是所有者说我应该解析数据。

The problem I have is that using jSoup, it retrieves the data, but if you look carefully, the website makes a new httpget and only after that the search is completed. 我的问题是使用jSoup可以检索数据,但是如果仔细看,网站将创建一个新的httpget,并且只有在搜索完成之后。 From what I could gather, i think it sends some paramethers in the header to. 从我可以收集的信息来看,我认为它在标头中发送了一些参数。

If i just use jSoup to call that like I get some data, and where the search should be I get the message: 如果我只是使用jSoup来调用它,就像我得到一些数据一样,那么搜索应该在哪里得到消息:

  Please activate Javascript to see the search results. 

Is there is a way to get the data? 有没有办法获取数据? I really need this, any help is very much appreciated. 我真的需要这个,非常感谢您的帮助。

Please help 请帮忙

您需要一个具有JavaScript功能的客户端,例如HtmlUnit或Selenium。

声明:本站的技术帖子网页,遵循CC BY-SA 4.0协议,如果您需要转载,请注明本站网址或者原文地址。任何问题请咨询:yoyou2525@163.com.

 
粤ICP备18138465号  © 2020-2024 STACKOOM.COM