使用 Python 从特定行开始读取和解析 HTML 个文件

Question

I have this Python code I'm trying to improve in order to read and parse some HTML files, but I want it to start from the line ie 415. Because I want to target the <div class="panel-body"> where there's the data I want to parse. Because there's already another <div class="panel-body"> , but it's not the right one I want to target. Here's my code:

for filename in os.listdir(folder):
    if filename.endswith('.html'):
        fname = os.path.join(folder, filename)
        print('Filename: {}'.format(fname))

        with open (fname, 'r', encoding='utf8') as f:
            soup = BeautifulSoup(f.read(), 'html.parser')
            info = soup.find_all('div' ,class_= 'panel-body')

Answer 1

You may extract the lines starting from 415 till end. Pass this block to BeautifulSoup to get data out of HTML. Here is the code.

from itertools import islice
from bs4 import BeautifulSoup
import os
fname =  "TestFile"
folder = "TestFolder"
for filename in os.listdir(folder):
    if filename.endswith('.html'):
       fname = os.path.join(folder, filename)
       print('Filename: {}'.format(fname))
with open (fname, 'r', encoding='utf8') as f:
    block = islice(f, 415, 600)
    for line in block:
        soup = BeautifulSoup(line, 'html.parser')
        info = soup.find_all('div', class_='panel-body')