AngularJS应用程序中的Web抓取

Question

I have an AngularJS application which currently uses http.get to get JSON data from an API. This works great.

I'm wondering if I can pass a static webpage URL , and scrape the results using the response from http.get ?

I've seen tutorials on web scraping with Node and JavaScript libraries like ScraperJS , but I haven't been able to successfully use these in an Angular (client-side) application. Is there anyway to use a JavaScript web scraping library in Angular?

Answer 1

There is no direct way to do so because this has nothing to do with Angular at all. Client-side JavaScript is just that. It runs on the client. What you need to do involves making an HTTP call for request URL and retrieving the HTML from a site, then parsing that HTML for various meta-data. That needs to be done via a server-side call to the site to load the data from the remote site.