Java Web scraping for yahoo finance, extracting analyst rating

Question

I am trying to get the analyst rating of a given stock from yahoo finance using Java. I am using jsoup but looks like when I print the main HTML I am unable to see output which I see in the browser console. Is there anything I am missing. Yahoo finance is full of JavaScript. So I don't see the script information in jsoup object.

Thanks bilal

Answer 1

You need to check all the requests being shown in your browser's network tab. One of them would have the data set you require, most probably in JSON.