Python 脚本 - 未能使用 beautifulSoup 绕过登录页面

Question

我有一个脚本可以绕过看起来像这样的登录页面

URL="http://mywebsite.com/logon.aspx"
headers = {"user-agent": "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/72.0.3626.109 Safari/537.36"}

username="username"
password="password"
s = Session()
s.verify = False

s.headers.update(headers)
r = s.get(URL)

soup=BeautifulSoup(r.content,"html.parser")

VIEWSTATE = soup.find(id="__VIEWSTATE")['value']
VIEWSTATEGENERATOR = soup.find(id="__VIEWSTATEGENERATOR")['value']
EVENTVALIDATION = soup.find(id="__EVENTVALIDATION")['value']

login_data={"__VIEWSTATE":VIEWSTATE,
"__VIEWSTATEGENERATOR":VIEWSTATEGENERATOR,
"__EVENTVALIDATION":EVENTVALIDATION,
"txtUsername":username,
"txtPassword":password,
"btnLogin":"Login"
}

#r = s.post(URL, data=login_data, verify=False)
r = s.post("http://mywebsite.com/logon.aspx", data=login_data)


r = s.get("http://mywebsite.com/SummaryReport/Index")

该脚本之前运行良好，但随后开始遇到 SSL 错误，因此我对其进行了更改，以便 session 的 verify=false

现在我没有收到 SSL 错误，但现在它不会将数据发布到登录页面，我不确定它是否相关，但非常感谢任何帮助

Answer 1

如果这是 SSL 错误，您将看到它的警告并且可以忽略。

/usr/local/lib/python3.5/dist-packages/urllib3/connectionpool.py:1004: InsecureRequestWarning: Unverified HTTPS request is being made to host 'ownwebsite.com'. Adding certificate verification is strongly advised. See: https://urllib3.readthedocs.io/en/latest/advanced-usage.html#ssl-warnings
 InsecureRequestWarning,

失败的是以下几行。

VIEWSTATE = soup.find(id="__VIEWSTATE")['value']

从 URL 收到的内容没有预期的 id __VIEWSTATE 并且返回None并尝试基于键“值”进行访问导致错误。

TypeError: 'NoneType' object is not subscriptable