使用python获取下拉HTML框中的数据

Question

I want to get the models in the drop box:

http://www.trademe.co.nz/motors/used-cars/bmw

from bs4 import BeautifulSoup
import requests 
url="http://www.trademe.co.nz/motors/used-cars/bmw"
r= requests.get(url)
soup = BeautifulSoup(r.content)


price=soup.find("select",{"id":"15"})
options = price.find_all("option")


print(options)

Output

[<option selected="selected" value="">Any model</option>]

I want a list of all the models in the dropbox.

Answer 1

Looks like the data is loaded using ajax. This way when you request the page with python, there is still only one option loaded.

Checking the Network tab in the chrome debugger you can get this url which returns the models for BMW . Now you can requests this url.

import requests
url = "http://www.trademe.co.nz/API/Ajax/UsedCarsModels.aspx?make=BMW"
data = requests.get(url).json()
print data['models']

Hope this helps you