[英]Why sending a post request doesn't work in python?
I want to parse data from a website after submitting a form and I'm using requests
library to do that. 提交表单后,我想从网站解析数据,而我正在使用requests
库来做到这一点。 This is the website . 这是网站 。 There is a form on that site. 该站点上有一个表格。 after submitting the form the page reloads and it generates a new table that contains the information, and that's the information I want. 提交表单后,页面将重新加载,并生成一个包含信息的新表,这就是我想要的信息。
This the header when I manually submit the form: 手动提交表单时的标题:
activeFormName:report_builder_form
repProviance:66
repStation:40754
parameters:1
start_year:1951
end_year:1963
SearchBtn:جستجو
SearchBtn:جستجو
__sisReportRowCount:10
__sisReportParamType:simple`
I send post request using a dictionary of data: 我使用数据字典发送请求:
import requests
from bs4 import BeautifulSoup
form_data = {
'activeFormName':'report_builder_form',
"repProviance": 66,
'repStation': 40754,
'parameters':1 ,
"start_year": 1951,
"end_year": 1963,
"SearchBtn":"%D8%AC%D8%B3%D8%AA%D8%AC%D9%88",
# "SearchBtn":"جستجو", ### This line and above are the same.
"__sisReportParamType": 'simple',
"__sisReportRowCount": 10
}
respones = requests.post(url,data=form_data)
s = BeautifulSoup(respones.content,'lxml')
but it always gives me an HTML file that contains no information. 但是它总是给我一个不包含任何信息的HTML文件。
import time
import requests
from bs4 import BeautifulSoup
headers = {'User-Agent': 'Mozilla/5.0 (Macintosh; Intel Mac OS X 10_10_1) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/39.0.2171.95 Safari/537.36'}
url = '.......'
ses = requests.Session()
respones = ses.get(url)
time.sleep(5)
pay_load = {
'activeFormName':'report_builder_form',
"repProviance": 66,
'repStation': 40754,
'parameters':1 ,
"start_year": 1951,
"end_year": 1963,
"SearchBtn":"%D8%AC%D8%B3%D8%AA%D8%AC%D9%88",
# "SearchBtn":"جستجو",
"__sisReportParamType": 'simple',
"__sisReportRowCount": 10
}
s =ses.post(respones.url, data=pay_load)
soup = BeautifulSoup(s.content,'html.parser')
print(soup.prettify())
try posting the data like this 尝试像这样发布数据
声明:本站的技术帖子网页,遵循CC BY-SA 4.0协议,如果您需要转载,请注明本站网址或者原文地址。任何问题请咨询:yoyou2525@163.com.