加载外部页面并使用它的元素，就像我通常会使用它们一样？

Question

Can I load an external page using Javascript and convert it to a DOM structure so I can scrape it like I would to it normally?

Bad explanation, but code says more than thousand words, I think. ;)

foobar  = loadExternalPage('foobar.com');
foobar  = convertToDOM(foobar);
headers = foobar.getElementsByClassName('header');

Thank you!

Answer 1

If the external page is on the same domain, then yes you can using XMLHttpRequest , then treating the response as HTML. Alternatively, load it into an iframe and access the resulting contentDocument .

For a page on another domain, however, it's a bit more complicated. You may want to look at PHP's DOMDocument , which you can use to parse HTML from any domain, and even pass it back to JavaScript if you make an AJAX call to your PHP script.

Answer 2

https://developer.mozilla.org/en/Code_snippets/HTML_to_DOM