在Java中使用Jsoup时输出异常

Question

I am getting this output when trying to use Jsoup to extract text from Wikipedia:

I dont have enough rep to post pictures as I am new to this site but its basically like this:

[]{k[]q[]f[]d[]d  etc..

Here is part of my code:

public static void scrapeTopic(String url)

{
    String html = getUrl("http://www.wikipedia.org/" + url);



    Document doc = Jsoup.parse(html);

    String contentText = doc.select("*").first().text();

    System.out.println(contentText);


}

It appears to get all the information but in the wrong format!

I appreciate any help given Thanks in advance

Answer 1

Here are some suggestion for you. While fetching general webpage, which doesn't require HTTP header's field to be set like cookie , user-agent just call:

Document doc = Jsoup.connect("givenURL").get();

This function read the webpage using a GET request. When you are selecting element using * , it returns any element, that is all the element of the document. Hence, calling doc.select("*").first() is returning the #root element. Try printing it to see:

System.out.println(doc.select("*").first().tagName()); // #root
System.out.println(doc.select("*").first());  // will print the whole document, 
System.out.println(doc); //print the whole document, the above action is pointless
System.out.println(doc.select("*").first()==doc); 
               // check whither they are equal, and it will print TRUE

I am assuming that you are just playing around to learn about this API, although selector is much powerful, but a good start should be trying general document manipulation function eg, doc.getElementsByTag() .

However, in my local machine, i was successful to fetch the Document and parsing it using your getURL() function !!