如何从多个文件夹和文件中读取特定段落

Question

I have a list that contains directories and filenames that I want to open, read a paragraph from and save that paragraph to a list.

The problem is that I don't know how to "filter" the paragraph out from the files and insert into my list.

My code so far.

rr = []
file_list = [f for f in iglob('**/README.md', recursive=True) if os.path.isfile(f)]
for f in file_list:
  with open(f,'rt') as fl:
    lines = fl.read()
    rr.append(lines)
  print(rr)

The format of the file I'm trying to read from. The text between the paragraph start and the new paragraph is what I'm looking for

There is text above this paragraph
## Required reading
    * line
    * line
    * line
     /n
### Supplementary reading
There is text bellow this paragraph

When I run the code I get all the lines from the files as expected.

Answer 1

You need to learn how your imported text is structured. How are the paragraphs segregated? does it look like '\\n\\n', could you split your text file on '\\n\\n' and return the index of the paragraph you want?

text = 'paragraph one text\n\nparagraph two text\n\nparagraph three text'.split('\n\n')[1]
print(text)
>>> 'paragraph two text'

The other option, as someone else mentioned is Regular Expression aka RegEx, which you can import using

import re

RegEx is used to find patterns in text.

Go to https://pythex.org/ and grab a sample of one of the documents and experiment findingthe pattern that will match with the paragraph you want to find.

Learn more about RegEx here https://regexone.com/references/python

Answer 2

Solved my problem with string slicing.

Basically, I just scan each line for a start String and an end String and makes lines out of that. These lines then get appended to a list and written into a file.

for f in file_list:
        with open(f, 'rt') as fl:
            lines = fl.read()
            lines = lines[lines.find('## Required reading'):lines.find('## Supplementary reading')]
            lines = lines[lines.find('## Required reading'):lines.find('### Supplementary reading')]
            lines = lines[lines.find('## Required reading'):lines.find('## Required reading paragraph')]
            rr.append(lines)

But I still have "## Required reading" in my list and in my file so I run a second read/write method.

def removeHashTag():
    global line
    f = open("required_reading.md", "r")
    lines = f.readlines()
    f.close()
    f = open("required_reading.md", "w")
    for line in lines:
        if line != "## Required reading" + "\n":
            f.write(line)
    f.close()
removeHashTag()