如何从我当前在机器上的浏览器中打开的网页中获取文本/html？

Question

I want to do something like this:

from lxml import html
import requests

page = requests.get('https://a-website.com/')

But instead of passing a defined hard-coded url, I would like to get the page that I currently have open in my web browser. ie page = requests.get(whateverisopeninmychrome) . For what it's worth, its the text contents of a div that I am specifically looking for.

Is there any way to do this or is it even possible? I could not find any other information about pulling the html/contents from a browser that is currently open on your machine.

Answer 1

No, you can't like this. One way is to open Developer Console on Google Chrome or Firefox with your website open and use javascript syntax like this:

For searching by className , it will return a list and you will have to get one element:

var html = document.getElementsByClassName('htmlClassHere')[0].innerText

For searching by id , it will return the element and you can use it like this:

var html = document.getElementsById('htmlIdHere').innerText