Python Selenium如何在跨度后从div获取文本

Question

I want to select text within a div after a span.

Source looks like this:

<div id="citation">
    <cite>Journal</cite>
    ", "
    <span class="year">2014</span>
    ", "
    <span class="volume">100</span>
    " (4), pp 100-200"
</div>

I only want the " (4), pp 100-200".

I know how to get text out of the entire div, or each span, but how do I grab only the last text? This XPATH will not work. ISSUE_XPATH = "//*[@id=\\"citation\\"]/text()[3]"

And shows this error message:

selenium.common.exceptions.InvalidSelectorException: Message: {"errorMessage":"The result of the xpath expression \\"//*[@id=\\"citation\\"]/text()[3]\\" is: [object Text]. It should be an element."

Answer 1

Unfortunately, //*[@id=\\"citation\\"]/text()[3] is not going to work in selenium - you can only target actual elements, not text nodes.

What I would do in this case is to additionally use BeautifulSoup HTML parser which would help to locate a specific text sibling after the span element with class="volume" :

from bs4 import BeautifulSoup

citation = driver.find_element_by_id("citation")
html = citation.get_attribute("outerHTML")

soup = BeautifulSoup(html, "html.parser")
desired_text = soup.find("span", class_="volume").next_sibling
print(desired_text)