python请求库重定向新页面以发布请求

Question

I am a newbie in python, and I have to retrieve the data of this page. http://mims.com/india/drug/search?q=dextro but as this website requires user login so I went through the following code.

import requests
from bs4 import BeautifulSoup as bs
POST_LOGIN_URL = "https://sso.mims.com/Account/Signin"
REQUEST_URL    = "https://mims.com/india/drug/search?q=DEXTRO%20PLUS"
payload = {
    "EmailAddress": "email address here",
    "Password"    : "password here"
}
with requests.Session() as session:
    post = session.post(POST_LOGIN_URL, data=payload)
    r = session.get(REQUEST_URL)
    with open('abc.html', 'wb')as f:
        f.write(r.content)

Instead of showing the desired result, it is redirecting me to a page and I am getting a "FORM" element which contains method="post" request and a button which autoclicks. So I am unable to figure it out please someone help.

Answer 1

Solved it using and after login or any other request.
So that background request completes it's execution and return to the required page.