Extract a word that follows a particular word from a webpage with python

Question

I am writing a simple web scraper script to extract a single word from a web page. The word I require changes regularly, but comes after a word that never changes, so I can search for it.

This my script so far:

#!/bin/python

import requests
response = requests.get('http://vpnbook.com/freevpn')
print(response.text)

Which obviously prints the whole HTML of the page. But the bit I need is the password:

<li>All bundles include UDP53, UDP 25000, TCP 80, TCP 443 profile</li>
<li>Username: <strong>vpnbook</strong></li>
<li>Password: <strong>binbd5ar</strong></li>
</ul>  

How could I print ONLY 'binbd5ar' (or whatever replaces it) to STOUT?

Answer 1

from bs4 import BeautifulSoup
import requests

response = requests.get('http://vpnbook.com/freevpn')
soup = BeautifulSoup(response.text, 'html.parser')
pricing = soup.find(id = 'pricing')
first_column = pricing.find('div', {'class': 'one-third'})
for li in first_column.find('ul', {'class': 'disc'}):
    if 'password' in str(li).lower():
        password = li.find('strong').text
print(password)

Answer 2

import re
re.search(r'Password: <strong>(.+)</strong>',response.text).group(1)

Answer 3

You can use regex search.

"Python offers two different primitive operations based on regular expressions: re.match() checks for a match only at the beginning of the string, while re.search() checks for a match anywhere in the string" link

>>> import re
>>> x = re.search(r"Password: <strong>(?P<pass>\w+)</strong>", response.text)
>>> print x.groupdict()
{'pass': 'binbd5ar'}

Answer 4

password = re.match(r'Password: <strong>(.*?)</strong>',response.text).group(1)

然后改变它

re.sub(password,newPassword,response.text,max = 1)