Python 请求 - 会话未捕获响应 cookie

Question

I'm not sure how else to describe this. I'm trying to log into a website using the requests library with Python but it doesn't seem to be capturing all cookies from when I login and subsequent requests to the site go back to the login page.

The code I'm using is as follows: (with redactions)

with requests.Session() as s:
    r = s.post('https://www.website.co.uk/login', data={
        'amember_login': 'username',
        'amember_password': 'password'
    })

Looking at the developer tools in Chrome. I see the following:

After checking r.cookies it seems only that PHPSESSID was captured there's no sign of the amember_nr cookie.

The value in PyCharm only shows:

{RequestsCookieJar: 1}<RequestsCookieJar[<Cookie PHPSESSID=kjlb0a33jm65o1sjh25ahb23j4 for .website.co.uk/>]>

Why does this code fail to save 'amember_nr' and is there any way to retrieve it?

SOLUTION :

It appears the only way I can get this code to work properly is using Selenium, selecting the elements on the page and automating the typing/clicking. The following code produces the desired result.

from seleniumrequests import Chrome

driver = Chrome()
driver.get('http://www.website.co.uk')
username = driver.find_element_by_xpath("//input[@name='amember_login']")
password = driver.find_element_by_xpath("//input[@name='amember_pass']")

username.send_keys("username")
password.send_keys("password")

driver.find_element_by_xpath("//input[@type='submit']").click() # Page is logged in and all relevant cookies saved.

Answer 1

You can try this:

with requests.Session() as s:
    s.get('https://www.website.co.uk/login')
    r = s.post('https://www.website.co.uk/login', data={
        'amember_login': 'username',
        'amember_password': 'password'
    })

The get request will set the required cookies.

Answer 2

FYI I would use something like BurpSuite to capture ALL the data being sent to the server and sort out what headers etc are required ... sometimes people/servers to referrer checking, set cookies via JAVA or wonky scripting, even seen java obfuscation and blocking of agent tags not in whitelist etc... it's likely something the headers that the server is missing to give you the cookie.

Also you can have Python use burp as a proxy so you can see exactly what gets sent to the server and the response.

https://github.com/freeload101/Python/blob/master/CS_HIDE/CS_HIDE.py (proxy support )