使用 bs4 请求抓取

Question

我正在尝试抓取此页面，但出现 406 错误。 请问我做错了什么？

import requests
from bs4 import BeautifulSoup

url="http://chucknorrisfacts.net/facts"

response = request.get(url)
print(response)

Answer 1

添加标题参数：

import requests
from bs4 import BeautifulSoup

url="http://chucknorrisfacts.net/facts"
headers = {'user-agent': 'Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/87.0.4280.66 Safari/537.36'}

response = requests.get(url,headers=headers)
print(response)