[英]Pandas read_csv not obeying a regex sep
数据 :
from io import StringIO
import pandas as pd
s = '''ID,Level,QID,Text,ResponseID,responseText,date_key,last
375280046,S,D3M,Which is your favorite?,D5M0,option 1,2012-08-08 00:00:00,ynot
375280046,S,D3M,How often? (at home, at work, other),D3M0,Work,2010-03-31 00:00:00,okkk
375280046,M,A78,Do you prefer a, b, or c?,A78C,a,2010-03-31 00:00:00,abc
376918925,M,A78,Which ONE (select only one),A78E,Milk,2004-02-02 00:00:00,launch Wed., '''
df = pd.read_csv(StringIO(s), sep=r',(?!\s)')
问题 :我在这里问了一个问题。 我遇到了一个新问题。 注意在最后一行的末尾,它是一个逗号和一个空格。 sep=r',(?!\\s)'
的正则表达式应该忽略后跟空格的逗号。
问题 :有没有办法将最后一列读作字面上的launch Wed.,
其中逗号不是分隔符/分隔符,但在last
列文本中实际上是逗号 - 仅使用pd.read_csv
?
错误 :
ValueError: Expected 8 fields in line 5, saw 9. Error could possibly be due to quotes being ignored when a multi-char delimiter is used.
预期/期望的输出 :
ID Level QID Text ResponseID \
0 375280046 S D3M Which is your favorite? D5M0
1 375280046 S D3M How often? (at home, at work, other) D3M0
2 375280046 M A78 Do you prefer a, b, or c? A78C
3 376918925 M A78 Which ONE (select only one) A78E
responseText date_key last
0 option 1 2012-08-08 00:00:00 ynot
1 Work 2010-03-31 00:00:00 okkk
2 a 2010-03-31 00:00:00 abc
3 Milk 2004-02-02 00:00:00 launch Wed.,
让我们来看看这篇SO帖子 。
使用上面解释的正则表达式r',(?=\\S)'
。
from io import StringIO
import pandas as pd
s = '''ID,Level,QID,Text,ResponseID,responseText,date_key,last
375280046,S,D3M,Which is your favorite?,D5M0,option 1,2012-08-08 00:00:00,ynot
375280046,S,D3M,How often? (at home, at work, other),D3M0,Work,2010-03-31 00:00:00,okkk
375280046,M,A78,Do you prefer a, b, or c?,A78C,a,2010-03-31 00:00:00,abc
376918925,M,A78,Which ONE (select only one),A78E,Milk,2004-02-02 00:00:00,launch Wed., '''
df = pd.read_csv(StringIO(s), sep=r',(?=\S)')
输出:
ID Level QID Text \
375280046 S D3M Which is your favorite? D5M0 option 1
S D3M How often? (at home, at work, other) D3M0 Work
M A78 Do you prefer a, b, or c? A78C a
376918925 M A78 Which ONE (select only one) A78E Milk
ResponseID responseText date_key last
375280046 S 2012-08-08 00 0 0 ynot
S 2010-03-31 00 0 0 okkk
M 2010-03-31 00 0 0 abc
376918925 M 2004-02-02 00 0 0 launch Wed.,
read_csv
似乎是在尝试识别分隔符之前从字符串末尾剥离空格。 这可以通过修改正则表达式以检查在文件结尾之前标识的逗号来解决:
pd.read_csv(StringIO(s), sep=r',(?!\s|\Z)', engine='python')
Out[347]:
ID Level QID Text ResponseID \
0 375280046 S D3M Which is your favorite? D5M0
1 375280046 S D3M How often? (at home, at work, other) D3M0
2 375280046 M A78 Do you prefer a, b, or c? A78C
3 376918925 M A78 Which ONE (select only one) A78E
responseText date_key last
0 option 1 2012-08-08 00:00:00 ynot
1 Work 2010-03-31 00:00:00 okkk
2 a 2010-03-31 00:00:00 abc
3 Milk 2004-02-02 00:00:00 launch Wed.,
声明:本站的技术帖子网页,遵循CC BY-SA 4.0协议,如果您需要转载,请注明本站网址或者原文地址。任何问题请咨询:yoyou2525@163.com.