如何使用JSoup登录网站并提取数据？

Question

I'm trying to extract data from fantasy.premierleague.com/transfers

Using JSoup and the following code, I can extract links from the homepage. However, to access the transfers page, I need to log in.

What should I add to this simple code so that I can login and access the transfers page?

public class StatsCollector {

public static void main (String [] args){

    try {
        Document doc = Jsoup.connect("http://fantasy.premierleague.com/transfers").get();
        Elements links = doc.select("a[href]");
        System.out.println(links);
    }  

    catch (IOException ex) {
        Logger.getLogger(StatsCollector.class.getName()).log(Level.SEVERE,null,ex);
    }
}

}

Answer 1

JSoup只是HTML解析器，您需要认证的是一些HTMLClient（例如Selenium），它可以在页面上执行某些操作（写入文本字段，单击按钮）。