繁体   English   中英

无法使用请求模块从网页检索 email

[英]Can't retrieve an email from a webpage using the requests module

我正在尝试使用请求模块从网页中获取 email。 问题是,地址 email 似乎被编码了或什么的,这就是它不可读的原因,我希望以通常的形式对其进行解码。

import requests
from bs4 import BeautifulSoup

link = 'https://global-standard.org/find-suppliers-shops-and-inputs/certified-suppliers/database/search_result/38996'

headers = {
    'User-Agent': 'Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/103.0.0.0 Safari/537.36',
}

res = requests.get(link,headers=headers)
soup = BeautifulSoup(res.text,"html.parser")
email = soup.select_one("script[type='text/javascript']:-soup-contains('emailProtector')").contents[0]
print(email)

当我运行上面的脚本时,我得到以下结果:

emailProtector.addCloakedMailto("ep_586c4771", 1);

这是我追求的结果:

fttextilegroup2017@gmail.com

你可以试试:

import re
import requests
from bs4 import BeautifulSoup


url = 'https://global-standard.org/find-suppliers-shops-and-inputs/certified-suppliers/database/search_result/38996'

def decloak(cloaked_tag, attr_name):
    a, b = "" , ""
    for span in cloaked_tag.select('span'):
        for attr in span.attrs:
            if attr == attr_name:
                a += span[attr]
            else:
                b = span[attr] + b
    return a + b

soup = BeautifulSoup(requests.get(url).content, 'html.parser')
attr_name = re.search(r'nodeName\.toLowerCase\(\)\.indexOf\("(.*?)"', str(soup)).group(1)
mail = decloak(soup.select_one('.cloaked_email'), attr_name)
print(mail)

印刷:

fttextilegroup2017@gmail.com

暂无
暂无

声明:本站的技术帖子网页,遵循CC BY-SA 4.0协议,如果您需要转载,请注明本站网址或者原文地址。任何问题请咨询:yoyou2525@163.com.

 
粤ICP备18138465号  © 2020-2024 STACKOOM.COM