使用python设置代理信息

Question

I am trying to send requests to a server from a corporate proxy. To do so, I am trying to set proxy info. I am basically trying to do the equivalent of the following R code:

set_config(use_proxy(url = "some_url", port = some_port, username = 
"some_user", password = "some_pass"))

in Python.

I have tried the following:

proxy = 'http://some_user:some_pass@some_url:some_port'
os.environ['http_proxy'] = proxy 
os.environ['HTTP_PROXY'] = proxy
os.environ['https_proxy'] = proxy
os.environ['HTTPS_PROXY'] = proxy
response = requests.post(url=url, data = data)

but it doesn't return the right results. Instead it gives an invalid credentials error. The exact same credentials work in R. What could I be missing.

Answer 1

You can pass your proxy through as a dict like this:

    proxy = 'http://some_user:some_pass@some_url:some_port'
    proxies = {
        'http': proxy,
        'https': proxy
    }

    response = requests.post(url, data=data, proxies=proxies)

Answer 2

Try also adding some headers:

headers = {
    "User-Agent": "Mozilla/5.0 (Windows NT 10.0; Win64; x64; rv:67.0) Gecko/20100101 Firefox/67.0",
    "Accept": "text/html,application/xhtml+xml,application/xml;q=0.9,*/*;q=0.8",
    "Accept-Language": "pt-BR,pt;q=0.8,en-US;q=0.5,en;q=0.3",
    "Connection": "keep-alive",
    "Upgrade-Insecure-Requests": "1",
    "Cache-Control": "max-age=0"
}

PROXY_HOST = ""
PROXY_PORT = ""
USERNAME = ""
PASSWORD = ""

proxies = {
  "http": "http://%s:%s@%s:%s" % (USERNAME, PASSWORD, PROXY_HOST, PROXY_PORT),
  "https": "https://%s:%s@%s:%s" % (USERNAME, PASSWORD, PROXY_HOST, PROXY_PORT)
}

requests.get(link, headers = headers, proxies = proxies)