[英]Pandas read_html results in TypeError
I'm using bs4 to parse a html page and extract a table, sample table given below and I'm trying to load it into pandas but when i call pddataframe = pd.read_html(LOTable,skiprows=2, flavor=['bs4'])
I get the error listed below but I can print the tables prettified by bs4 我正在使用bs4解析html页面并提取表,下面给出的示例表,并且尝试将其加载到熊猫中,但是当我调用
pddataframe = pd.read_html(LOTable,skiprows=2, flavor=['bs4'])
我收到下面列出的错误,但是我可以打印由bs4修饰的表
Any suggestions how I can resolve this without needing to get each td and read in 1 by 1? 有什么建议可以解决这个问题,而无需获取每个td并以1的比例读取吗?
<table cellpadding="5" cellspacing="0" class="borders" width="100%">
<tr>
<th colspan="2">
Learning Outcomes
</th>
</tr>
<tr>
<td class="info" colspan="2">
On successful completion of this module the learner will be able to:
</td>
</tr>
<tr>
<td style="width:10%;">
LO1
</td>
<td>
Demonstrate an awareness of the important role of Financial Accounting information as an input into the decision making process.
</td>
</tr>
<tr>
<td style="width:10%;">
LO2
</td>
<td>
Display an understanding of the fundamental accounting concepts, principles and conventions that underpin the preparation of Financial statements.
</td>
</tr>
<tr>
<td style="width:10%;">
LO3
</td>
<td>
Understand the various formats in which information in relation to transactions or events is recorded and classified.
</td>
</tr>
<tr>
<td style="width:10%;">
LO4
</td>
<td>
Apply a knowledge of accounting concepts,conventions and techniques such as double entry to the posting of recorded information to the T accounts in the Nominal Ledger.
</td>
</tr>
<tr>
<td style="width:10%;">
LO5
</td>
<td>
Prepare and present the financial statements of a Sole Trader in prescribed format from a Trial Balance accompanies by notes with additional information.
</td>
</tr>
</table>
--------------------------------------------------------------------------- TypeError Traceback (most recent call last) <ipython-input-20-12673b1a4bfc> in <module>()
10 #Read table into pandas
11 if first:
---> 12 pddataframe = pd.read_html(LOTable,skiprows=2, flavor=['bs4'])
13 first = False
14 pddataframe
C:\Program Files\Anaconda3\envs\LearningOutcomes\lib\site-packages\pandas\io\html.py in read_html(io, match, flavor, header, index_col, skiprows, attrs, parse_dates, tupleize_cols, thousands, encoding)
872 _validate_header_arg(header)
873 return _parse(flavor, io, match, header, index_col, skiprows,
--> 874 parse_dates, tupleize_cols, thousands, attrs, encoding)
C:\Program Files\Anaconda3\envs\LearningOutcomes\lib\site-packages\pandas\io\html.py in _parse(flavor, io, match, header, index_col, skiprows, parse_dates, tupleize_cols, thousands, attrs, encoding)
734 break
735 else:
--> 736 raise_with_traceback(retained)
737
738 ret = []
C:\Program Files\Anaconda3\envs\LearningOutcomes\lib\site-packages\pandas\compat\__init__.py in raise_with_traceback(exc, traceback)
331 if traceback == Ellipsis:
332 _, _, traceback = sys.exc_info()
--> 333 raise exc.with_traceback(traceback)
334 else:
335 # this version of raise is a syntax error in Python 3
**TypeError: 'NoneType' object is not callable**
Thanks for the pointers from all the suggested answers and comments, my rookie mistake was I had the table in a variable after extracting it using bs4. 感谢所有建议的答案和评论的指针,我的菜鸟错误是我使用bs4提取表后将表放入变量中。 I was running
pd.read_html(LOTable,skiprows=2, flavor='bs4')
when I needed to run pd.read_html(LOTable.prettify(),skiprows=2, flavor='bs4')
我跑
pd.read_html(LOTable,skiprows=2, flavor='bs4')
当我需要运行pd.read_html(LOTable.prettify(),skiprows=2, flavor='bs4')
Pandas can guess. 熊猫可以猜测。
HTML = '''\
<table cellpadding="5" cellspacing="0" class="borders" width="100%">
<tr>
<th colspan="2">
Learning Outcomes
</th>
... omitting most of what you had here
Prepare and present the financial statements of a Sole Trader in prescribed format from a Trial Balance accompanies by notes with additional information.
</td>
</tr>
</table>'''
from io import StringIO
import pandas as pd
df = pd.read_html(StringIO(HTML))
print (df)
Result: 结果:
[ 0 \
0 Learning Outcomes
1 On successful completion of this module the le...
2 LO1
3 LO2
4 LO3
5 LO4
6 LO5
1
0 NaN
1 NaN
2 Demonstrate an awareness of the important role...
3 Display an understanding of the fundamental ac...
4 Understand the various formats in which inform...
5 Apply a knowledge of accounting concepts,conve...
6 Prepare and present the financial statements o... ]
This exact code works for me. 这个确切的代码对我有用。
htm = """<table cellpadding="5" cellspacing="0" class="borders" width="100%">
<tr>
<th colspan="2">
Learning Outcomes
</th>
</tr>
<tr>
<td class="info" colspan="2">
On successful completion of this module the learner will be able to:
</td>
</tr>
<tr>
<td style="width:10%;">
LO1
</td>
<td>
Demonstrate an awareness of the important role of Financial Accounting information as an input into the decision making process.
</td>
</tr>
<tr>
<td style="width:10%;">
LO2
</td>
<td>
Display an understanding of the fundamental accounting concepts, principles and conventions that underpin the preparation of Financial statements.
</td>
</tr>
<tr>
<td style="width:10%;">
LO3
</td>
<td>
Understand the various formats in which information in relation to transactions or events is recorded and classified.
</td>
</tr>
<tr>
<td style="width:10%;">
LO4
</td>
<td>
Apply a knowledge of accounting concepts,conventions and techniques such as double entry to the posting of recorded information to the T accounts in the Nominal Ledger.
</td>
</tr>
<tr>
<td style="width:10%;">
LO5
</td>
<td>
Prepare and present the financial statements of a Sole Trader in prescribed format from a Trial Balance accompanies by notes with additional information.
</td>
</tr>
</table>
"""
pd.read_html(htm, skiprows=2, flavor='bs4')[0]
声明:本站的技术帖子网页,遵循CC BY-SA 4.0协议,如果您需要转载,请注明本站网址或者原文地址。任何问题请咨询:yoyou2525@163.com.