正则表达式以模式拆分新行
[英]Regex to split on new lines with a pattern
问题描述
我正在尝试将一个字符串拆分为多个字符串（如观察）。
例如，带有 3 个“投标人 ID”观察值的示例文本是：
BID RANK BID TOTAL BIDDER ID BIDDER INFORMATION (NAME/ADDRESS/LOCATION)
-------- ----------- --------- -------------------------------------------------
1 1,486,399.87 5 ORTIZ ASPHALT PAVING INC 909 386-1200 SB PREF CLAIMED
00814766
P O BOX 883 FAX 909 386-1288
COLTON CA 92324
2 1,534,243.00 3 EXCEL PAVING COMPANY 562 599-5841 SB PREF CLAIMED
00688659
2230 LEMON AVENUE FAX 562 591-7485
LONG BEACH CA 90806
3 1,593,549.40 2 SECURITY PAVING COMPANY INC 818 767-8418 CC PREF CLAIMED
00116307
P O BOX 1489 FAX 818 767-3169
SUN VALLEY CA 91353-1489
最终目标是创建一个模仿此文本文档的数据集。 第一步是将这个大字符串拆分为多个小字符串。 例如，三个小字符串如下所示：
拆分字符串 1
1 1,486,399.87 5 ORTIZ ASPHALT PAVING INC 909 386-1200 SB PREF CLAIMED
00814766
P O BOX 883 FAX 909 386-1288
COLTON CA 92324
拆分字符串 2
2 1,534,243.00 3 EXCEL PAVING COMPANY 562 599-5841 SB PREF CLAIMED
00688659
2230 LEMON AVENUE FAX 562 591-7485
LONG BEACH CA 90806
拆分字符串 3
3 1,593,549.40 2 SECURITY PAVING COMPANY INC 818 767-8418 CC PREF CLAIMED
00116307
P O BOX 1489 FAX 818 767-3169
SUN VALLEY CA 91353-1489
我开始使用拆分模式作为[\r\n]+\s+ ，但不幸的是，它被任何新行拆分，而不仅仅是没有其他字符/文本的新行。
代码：
# imports
import os
import pandas as pd
import re
import docx2txt
import textract
import antiword
txt = " 1 1,486,399.87 5 ORTIZ ASPHALT PAVING INC 909 386-1200 SB PREF CLAIMED
00814766
P O BOX 883 FAX 909 386-1288
COLTON CA 92324
2 1,534,243.00 3 EXCEL PAVING COMPANY 562 599-5841 SB PREF CLAIMED
00688659
2230 LEMON AVENUE FAX 562 591-7485
LONG BEACH CA 90806
3 1,593,549.40 2 SECURITY PAVING COMPANY INC 818 767-8418 CC PREF CLAIMED
00116307
P O BOX 1489 FAX 818 767-3169
SUN VALLEY CA 91353-1489"
p = re.split("[\r\n]+",txt)
但它会按所有可能的新行拆分文本。 有没有办法用没有其他字符的换行符分隔文本？ 太感谢了！！
PS 如果您认为我做错了什么或者有更简单的方法来创建数据集 - 请告诉我。 任何帮助表示赞赏。 谢谢！！
2 个解决方案
解决方案1
1 已采纳 2023-02-01 21:18:30
您可以尝试使用模式 ( re.findall ) 的re.findall ：
(?ms)^\s{,20}\d.*?(?=^\s{,20}\d|\Z)
import re
text = """\
BID RANK BID TOTAL BIDDER ID BIDDER INFORMATION (NAME/ADDRESS/LOCATION)
-------- ----------- --------- -------------------------------------------------
1 1,486,399.87 5 ORTIZ ASPHALT PAVING INC 909 386-1200 SB PREF CLAIMED
00814766
P O BOX 883 FAX 909 386-1288
COLTON CA 92324
2 1,534,243.00 3 EXCEL PAVING COMPANY 562 599-5841 SB PREF CLAIMED
00688659
2230 LEMON AVENUE FAX 562 591-7485
LONG BEACH CA 90806
3 1,593,549.40 2 SECURITY PAVING COMPANY INC 818 767-8418 CC PREF CLAIMED
00116307
P O BOX 1489 FAX 818 767-3169
SUN VALLEY CA 91353-1489"""
groups = re.findall(r"(?ms)^\s{,20}\d.*?(?=^\s{,20}\d|\Z)", text)
for group in groups:
print(group)
print('-' * 80)
印刷：
1 1,486,399.87 5 ORTIZ ASPHALT PAVING INC 909 386-1200 SB PREF CLAIMED
00814766
P O BOX 883 FAX 909 386-1288
COLTON CA 92324
--------------------------------------------------------------------------------
2 1,534,243.00 3 EXCEL PAVING COMPANY 562 599-5841 SB PREF CLAIMED
00688659
2230 LEMON AVENUE FAX 562 591-7485
LONG BEACH CA 90806
--------------------------------------------------------------------------------
3 1,593,549.40 2 SECURITY PAVING COMPANY INC 818 767-8418 CC PREF CLAIMED
00116307
P O BOX 1489 FAX 818 767-3169
SUN VALLEY CA 91353-1489
--------------------------------------------------------------------------------
解决方案2
1 2023-02-01 21:52:24
您可以使用以下方法捕获这些块：
(?=^[ \t]+(?:\d+[ \t]+[\d,.]+[ \t]+\d))([\s\S]+?)(?=(?:^[ \t]+\d+[ \t]+[\d,.]+[ \t]+\d)|\Z)
或者像这样拆分并通过在拆分前弹出 2 行来处理 header：
re.split(r'(?:\r?\n){2}, s)
Python 演示：
s='''\
BID RANK BID TOTAL BIDDER ID BIDDER INFORMATION (NAME/ADDRESS/LOCATION)
-------- ----------- --------- -------------------------------------------------
1 1,486,399.87 5 ORTIZ ASPHALT PAVING INC 909 386-1200 SB PREF CLAIMED
00814766
P O BOX 883 FAX 909 386-1288
COLTON CA 92324
2 1,534,243.00 3 EXCEL PAVING COMPANY 562 599-5841 SB PREF CLAIMED
00688659
2230 LEMON AVENUE FAX 562 591-7485
LONG BEACH CA 90806
3 1,593,549.40 2 SECURITY PAVING COMPANY INC 818 767-8418 CC PREF CLAIMED
00116307
P O BOX 1489 FAX 818 767-3169
SUN VALLEY CA 91353-1489'''
import re
# with re.split:
print(
"\n-------\n".join(re.split(r'(?:\r?\n){2,}', "\n".join(s.splitlines()[2:])))
)
# with re.findall:
print(
"\n-------\n".join(re.findall(r'(?=^[ \t]+(?:\d+[ \t]+[\d,.]+[ \t]))([\s\S]+?)(?=(?:^[ \t]+\d+[ \t]+[\d,.]+[ \t])|\Z)', s, flags=re.M))
)
两种方法都打印：
1 1,486,399.87 5 ORTIZ ASPHALT PAVING INC 909 386-1200 SB PREF CLAIMED
00814766
P O BOX 883 FAX 909 386-1288
COLTON CA 92324
-------
2 1,534,243.00 3 EXCEL PAVING COMPANY 562 599-5841 SB PREF CLAIMED
00688659
2230 LEMON AVENUE FAX 562 591-7485
LONG BEACH CA 90806
-------
3 1,593,549.40 2 SECURITY PAVING COMPANY INC 818 767-8418 CC PREF CLAIMED
00116307
P O BOX 1489 FAX 818 767-3169
SUN VALLEY CA 91353-1489
如何在模式匹配之前使用正则表达式将字符串拆分为多行
[英]How to split a string into multiple lines using regex before the pattern match
用python中的新行、符号和带空格的正则表达式分割字符串
[英]Split string with regex by new lines, symbols and withspaces in python
声明:本站的技术帖子网页，遵循CC BY-SA 4.0协议，如果您需要转载，请注明本站网址或者原文地址。任何问题请咨询:yoyou2525@163.com.