使用jsoup登录网站

Question

I tried to look everywhere to find a solution for my problem without any success. I'm trying to login to http://www.dailystrength.org/ website, however, my code doesn't work properly since I'm seeing that my crawler can't access some users' profiles that are private for non-registered members.

Here is my code:

String loginUrl = source + "/index.php?option=com_comprofiler&task=login";
Document login = Jsoup.connect(loginUrl).timeout(20000).get();
Map<String, String> parameters = new HashMap<String, String>();
Elements inputs = login.select("input");

for(Element input : inputs)
{
    parameters.put(input.attr("name"), input.attr("value"));
}

parameters.put("username", "user");
parameters.put("passwd", "pass");
parameters.put("remember", "yes");

cookies = Jsoup.connect(loginUrl).data(parameters).method(org.jsoup
          .Connection.Method.POST).timeout(20000).execute().cookies();

I tried also to include hidden input values, but it didn't work too. Any help would be much appreciated.

Thank you

Answer 1

Hey you can use Htmlunit and jsoup. For login use Htmlunit, its easy, you just need to submit form with username and password, after login, new page will come and you can deal with jsoup with that new page.

Answer 2

Is this what u were trying to do

String loginUrl = "http://www.dailystrength.org/" + "/index.php?option=com_comprofiler&task=login";
    Document login = Jsoup.connect(loginUrl).timeout(20000).header("username", "user").header("passwd", "pass").header("remember", "yes").post();
    Map<String, String> parameters = new HashMap<String, String>();
    Elements inputs = login.select("input");
for(Element input : inputs)
{
    String thi= input.attr("name");
    String  thi2=input.attr("value");
    System.out.println("THIS" + thi);
    System.out.println("THIS2" + thi2);
parameters.put(input.attr("name"), input.attr("value"));
}

Hope this works for u