What is the Selenium equivalent of using Google Chrome Developer Tools and clicking "Copy OuterHTML" on the outermost HTML element?

Question

Previously, I was just using Google Chrome and its Developer Tools to Copy/Paste the HTML Code of a certain website.

I was just manually using Google Chrome Developer Tools and right-clicking on the outermost HTML class and pressing "Copy OuterHTML" and then I would paste that into a notepad text file and get to work on it.

But now, I want to automate this process. I want to use Selenium to grab the HTML.

I have used the following, but they do not get me the same exact result (they are missing some internal html elements and stuff) as Copying the HTML Code Manually using Google Chrome:

driver.page_source driver.execute_script("return document.documentElement.outerHTML")

Any other ideas?

Answer 1

Did you tried to use Beautiful Soup ? It's a scrapper that grab all the HTML from a page, and then you can select elements like with Selenium. But you can't navigate the page to trigger JS or click on buttons.

You can also try

driver.find_element_by_tag_name('html').get_attribute('outerHTML')