简体繁体 English

从网站获取的数据未显示在html标记代码中

[英]get data from website not showing up in html mark-up code

原文 2014-12-12 10:07:34 9 1 html/ matlab/ urlread

I am trying to retrieve data from a website for which the parameters that you need to define does not show up in the url ie. 我正在尝试从网站中检索数据，而您需要为其定义的参数未显示在url中。 http://www.vmm.be/webrap/ibmcognos/cgi-bin/cognosisapi.dll?b_action=cognosViewer&ui.action=run&ui.object=%2fcontent%2ffolder[%40name%3d%27Water%27]%2ffolder[%40name%3d%27Afvalwater%27]%2freport[%40name%3d%27Individuele%20analyseresultaten%20per%20RWZI%27]&ui.name=Individuele%20analyseresultaten%20per%20RWZI&run.outputFormat=HTML&run.prompt=false&ui.backURL=%2fwebrap%2fibmcognos%2fcgi-bin%2fcognosisapi.dll%3fb_action%3dxts.run%26m%3dportal%2fcc.xts%26m_folder%3di5DDA04E5A00C4B6AB6DF44BB4FAD7CEC&p_RwziNr=51&run.prompt=false http://www.vmm.be/webrap/ibmcognos/cgi-bin/cognosisapi.dll?b_action=cognosViewer&ui.action=run&ui.object=%2fcontent%2ffolder[%40name%3d%27Water%27]%2ffolder[% 40name％3d％27Afvalwater％27]％2freport [％40name％3d％27Individuele％20analyseresultaten％20per％20RWZI％27]＆ui.name = Individuele％20analyseresultatenn％20per％20RWZI＆run.outputFormat = HTML＆run.prompt = false＆ui2 ％2fibmcognos％2fcgi-bin％2fcognosisapi.dll％3fb_action％3dxts.run％26m％3dportal％2fcc.xts％26m_folder％3di5DDA04E5A00C4B6AB6DF44BB4FAD7CEC＆p_RwziNr = 51＆run。

how can I extract the data for different years and parameters in a programmatic way? 如何以编程方式提取不同年份和参数的数据？

I am using matlab's urlread but since the data I want to import does not show up in the html-code (I have checked this with the Web Developer Toolbar in FireFox), nothing is being read in. I have no experience with websites, only matlab and c-programming, so I have no idea how the data can be shown in the browser if it is not showing up in the html-source code so could someone point me to the right direction on how to get this job done? 我正在使用matlab的urlread，但是由于要导入的数据未显示在html代码中（我已经在FireFox中的Web Developer Toolbar中进行了检查），因此未读取任何内容。我对网站没有任何经验，只有matlab和c编程，所以我不知道如果数据没有显示在html源代码中，那么如何在浏览器中显示数据，所以有人可以为我指出完成这项工作的正确方向吗？ Is it at all possible? 有可能吗？ I hope so because I will have to repeat this for around 500 measuring stations, each 10 years so I am not planning on copying the required data manually as I did before when I just needed one station. 我希望如此，因为我将不得不在每10年重复大约500个测量站，所以我不打算像以前只需要一个站一样手动复制所需的数据。

1 个解决方案

it turns out it is not possible to do what I want in Matlab. 事实证明，不可能在Matlab中做我想做的事情。 I however did manage to get the required data programmatically by using a combination of Selenium with C# and chrome driver. 但是，我确实通过结合使用Selenium和C＃和chrome驱动程序来以编程方式获取了所需的数据。 It's slow, but it's working and I can do other stuff in the meanwhile so I can recommend it to everyone who is downloading data from servers in a tedious way. 它的速度很慢，但是可以正常工作，同时我还可以做其他事情，因此我可以推荐给所有以繁琐的方式从服务器下载数据的人。