python 从 url 或元素按钮抓取页面 + 下一页循环

Question

It just prints the first page does not go and prints the other page where is the problem? I'm new to Python

from urllib.request import urlopen
from bs4 import BeautifulSoup
import re
import requests

for num in range(1,6):     #Number of pages plus one
    url = (f'https://test.com/%D9%84-%8%B6/{num}')
    html = urlopen(url)
    r = requests.get(url)
    bs = BeautifulSoup(html,'html.parser')

Answer 1

You want to be doing something like so:

from bs4 import BeautifulSoup
import requests

for num in range(1, 6):  # Number of pages plus one
    url = f"https://google.com/{num}"
    r = requests.get(url)
    bs = BeautifulSoup(r.text, "html.parser")
    print(bs)

urllib.request import urlopen is not needed for this.

---

Regarding the comments below, here is getting the title of my website with BeautifulSoup :

from bs4 import BeautifulSoup
import requests

url = "https://self.st"  # You would have your number here.
r = requests.get(url)
bs = BeautifulSoup(r.text, "html.parser")

title = bs.find("div", {"class": "title"})

print(title)
print(title.text)

Outputs:

<div class="title">felipe faria</div>
felipe faria