在Java中将html String转换为org.w3c.dom.Document

Question

To convert from HTML String to

org.w3c.dom.Document

I'm using

jtidy-r938.jar

here is my code:

public static Document getDoc(String html) {
        Tidy tidy = new Tidy();
        tidy.setInputEncoding("UTF-8");
        tidy.setOutputEncoding("UTF-8");
        tidy.setWraplen(Integer.MAX_VALUE);
        // tidy.setPrintBodyOnly(true);
        tidy.setXmlOut(false);
        tidy.setShowErrors(0);
        tidy.setShowWarnings(false);
        // tidy.setForceOutput(true);
        tidy.setQuiet(true);
        Writer out = new StringWriter();
        PrintWriter dummyOut = new PrintWriter(out);
        tidy.setErrout(dummyOut);
        tidy.setSmartIndent(true);
        ByteArrayInputStream inputStream = new ByteArrayInputStream(html.getBytes());
        Document doc = tidy.parseDOM(inputStream, null);
        return doc;
    }

But sometime the library work incorrectly, some tag is lost.

Please tell a good open library to do this task.

Thanks very much!

Answer 1

You don't tell why sometimes the library doesn't give the good result. Nevertheless, i am working very regularly with html files where I must extract data from and the main problem encountered is that fact that some tags are not valid because not closed for example. The best solution i found to resolve is the api htmlcleaner ( htmlCleaner Website ).

It allows you to make your html file well formed. Then, to transform it in document w3c or another strict format file is easier.

With HtmlCleaner, you could do such as :

HtmlCleaner cleaner = new HtmlCleaner();
TagNode node = cleaner.clean(html);
DomSerializer ser = new DomSerializer(cleaner.getProperties());
Document myW3cDoc = ser.createDOM(node);

I refer DomSerializer from htmlcleaner.