request.get在python scraper中不起作用

Question

Hi I am trying to make this basic scraper work, where it should go to a website fill "City" and "area" ,search for restaurants and return the html page.

This is the code i'm using

payload = OrderedDict([('cityId','NewYork'),('area','Centralpark')])

req = requests.get("http://www.somewebsite.com",params=payload)

f = req.content 
soup = BeautifulSoup((f))

And Here is how the Source HTML looks like

When I'm checking the resulting soup variable it doesn't have the search results , instead it contains the data from the first page only,which has the form for entering city and area value (ie www.somewebsite.com, what i want is results of www.somewebsite.com?cityId=NewYork&area=centralPark ).So Is there anything that i have to pass with that params to explicitly press the search button or is there any other way to make it work.

Answer 1

您首先需要检查是否可以通过Web浏览器访问URL并获得正确的结果。