[英]I need to download images referenced in the href attribute of anchors using Python Selenium
检索到的链接应以顺序方式获得,以便进行进一步处理。 这是我现在尝试过的:
lay = driver.find_element_by_xpath('//*[@id="app"]/div/div[4]/div[2]/div/div[1]/div/div')
fig = lay.find_elements_by_class_name('_2Mc8_')
for link in fig:
href = link.get_attribute("href")
print href
for ab in href:
ab = driver.get(href)
dwn = driver.find_element_by_xpath('//*[@id="app"]/div/div[3]/div/div[1]/div[1]/header/div[2]/div[3]/a/span')
dwn.click()
time.sleep(2)
前一段时间我有一个这样的项目。 您要做的是打开一种流,然后将对象下载到该流,然后再次将其关闭。
def requests_image(file_url):
i = requests.get(file_url)
if i.status_code == requests.codes.ok:
#save the file as a temporary name. Note that this is a static name, so I won't be able to run two threads at the same time.
with iopen("images/TEMP_file_name", 'wb') as file:
file.write(i.content)
#this is to get the correct extension of the file. Handy when you can't derive it from the URL.
ext = imghdr.what("images/TEMP_file_name")
file.close()
uidname = str(int(time.time()))[-8:]
##Create unique filename using UNIXTIME[-8:] (last 8 chars of unixtime in S)
filename = uidname+"."+ext
#Now that the stream is closed, rename it from the static name to a unique name. I chose to use time since epoch. Add the extension and you're good to go.
os.rename("images/TEMP_file_name", "images/"+filename)
return(filename)
else:
return False
以上是我要使用的功能。 要调用它,只需执行以下操作:
fname = requests_image(href)
if fname: #truthy statement
pass #if you have a succesfull file returned it might be needed to store it in a database. use the fname variable for this.
else:
pass# if the filename returns false (might be if the link turns out to be invalid) log it and investigate if it's essential to know.
lay = driver.find_element_by_xpath('//')
fig = lay.find_elements_by_class_name('_2Mc8_')
for link in fig:
href = link.get_attribute("href")
print href
for ab in href:
driver.get(ab)
dwn = driver.find_element_by_xpath('//')
dwn.click()
time.sleep(2)
声明:本站的技术帖子网页,遵循CC BY-SA 4.0协议,如果您需要转载,请注明本站网址或者原文地址。任何问题请咨询:yoyou2525@163.com.