python 从 url 或元素按钮抓取页面 + 下一页循环

Question

它只打印第一页而不是 go 并打印另一页 问题出在哪里？ 我是 Python 的新手

from urllib.request import urlopen
from bs4 import BeautifulSoup
import re
import requests

for num in range(1,6):     #Number of pages plus one
    url = (f'https://test.com/%D9%84-%8%B6/{num}')
    html = urlopen(url)
    r = requests.get(url)
    bs = BeautifulSoup(html,'html.parser')

Answer 1

你想做这样的事情：

from bs4 import BeautifulSoup
import requests

for num in range(1, 6):  # Number of pages plus one
    url = f"https://google.com/{num}"
    r = requests.get(url)
    bs = BeautifulSoup(r.text, "html.parser")
    print(bs)

为此不需要urllib.request import urlopen 。

---

关于下面的评论，这里是用BeautifulSoup获得我的网站的标题：

from bs4 import BeautifulSoup
import requests

url = "https://self.st"  # You would have your number here.
r = requests.get(url)
bs = BeautifulSoup(r.text, "html.parser")

title = bs.find("div", {"class": "title"})

print(title)
print(title.text)

输出：

<div class="title">felipe faria</div>
felipe faria