Jsoup解析器仅对特定URL无法正常工作

Question

I am using Jsoup to download the page content and then for parsing it.

public static void main(String[] args) throws IOException {
        Document document = Jsoup.connect("http://www.toysrus.ch/product/index.jsp?productId=89689681").get();
        final Elements elements = document.select("dt:contains(" + "EAN/ISBN:" + ")");
        System.out.println(elements.size());
    }

The Problem : If you view the source of page content, there is tag exist <dt> which contains EAN/ISBN: text, but if you run above code, it will give you 0 in output, while it should give me 1 . I have already checked html using document.html() , it seems html tags are there, but the tag I wanted is replaced by characters like <dt> instead it should <dt> . Same code is working for other product urls from same site.

I have already worked with Jsoup and developed many parser, but I am not getting why above very simple code is not working. It's strange! Is it Jsoup bug? Can anybody help me?

Answer 1

When using connect() or parse() jsoup will per default expect a valid html and format the input automatically if needed. You may try the xml parser instead.

    public static void main(String [] args) throws IOException { 
        String url = "http://www.toysrus.ch/product/index.jsp?productId=89689681";
        Document document = Jsoup.parse(new URL(url).openStream(), "UTF-8", "", Parser.xmlParser());
        //final Elements elements = document.select("dt:contains(" + "EAN/ISBN:" + ")");
        // the same as above but more readable:
        final Elements elements = document.getElementsMatchingOwnText("EAN/ISBN");            
        System.out.println(elements.size());
    }

Answer 2

You need to put single quotes around the 'EAN/ISBN:' value; otherwise it will be interpreted as a variable.

Also, there is no need to break up the string and concatenate pieces together. Just put the whole thing in one string.