堆栈内存溢出
  简体   繁体   English

如何使用 python 从多个 XML 节点和层次结构中提取信息？

[英]How to extract information from multiple XML nodes and hierarchies using python?

 原文  2020-05-29 12:19:46  0   1    python/ xml/ elementtree/ jmespath

问题描述

I have the following structure:我有以下结构：

<population>
    <person id="101">
        <attributes>
            <attribute name="age" class="java.lang.Integer" >53</attribute>
        </attributes>
        <plan score="-0.38" selected="yes">
            <activity type="outside" link="81312" facility="outside_208" x="649324.9906891582" y="6866581.699995641" end_time="08:22:00" >
            </activity>
            <leg mode="car" dep_time="08:22:00" trav_time="00:10:13">
                <route type="links" start_link="81312" end_link="138852" trav_time="00:10:13" distance="6046.54932060571" vehicleRefId="7262234">81312</route>
            </leg>
            <activity type="work" link="138852" facility="38407" x="651680.6" y="6863892.5" start_time="08:45:22" end_time="17:15:22" >
                <attributes>
                    <attribute name="innerParis" class="java.lang.Boolean" >true</attribute>
                </attributes>
            </activity>
            <leg mode="car" dep_time="17:15:22" trav_time="00:07:05">
                <route type="links" start_link="138852" end_link="189898" trav_time="00:07:05" distance="4604.544053407517" vehicleRefId="7262234">138852</route>
            </leg>
            <activity type="outside" link="189898" facility="outside_249" x="648729.9598002436" y="6866057.250182923" end_time="17:20:35" >
            </activity>
        </plan>
        <plan score="-0.38" selected="no">
            <activity type="inside" link="81312" facility="outside_208" x="649324.9906891582" y="6866581.699995641" end_time="08:22:00" >
            </activity>
            <leg mode="bike" dep_time="08:22:00" trav_time="00:10:13">
                <route type="links" start_link="81312" end_link="138852" trav_time="00:10:13" distance="6046.54932060571" vehicleRefId="7262234">81312</route>
            </leg>
            <activity type="shopping" link="138852" facility="38407" x="651680.6" y="6863892.5" start_time="08:45:22" end_time="17:15:22" >
                <attributes>
                    <attribute name="innerParis" class="java.lang.Boolean" >true</attribute>
                </attributes>
            </activity>
            <leg mode="bike" dep_time="08:22:00" trav_time="00:10:13">
                <route type="links" start_link="81312" end_link="138852" trav_time="00:10:13" distance="6046.54932060571" vehicleRefId="7262234">81312</route>
            </leg>
            <activity type="work" link="138852" facility="38407" x="651680.6" y="6863892.5" start_time="08:45:22" end_time="17:15:22" >
                <attributes>
                    <attribute name="innerParis" class="java.lang.Boolean" >true</attribute>
                </attributes>
            </activity>
            <leg mode="pt" dep_time="17:15:22" trav_time="00:07:05">
                <route type="links" start_link="138852" end_link="189898" trav_time="00:07:05" distance="4604.544053407517" vehicleRefId="7262234">138852</route>
            </leg>
            <activity type="outside" link="189898" facility="outside_249" x="648729.9598002436" y="6866057.250182923" end_time="17:20:35" >
            </activity>
        </plan>
    </person>
    <person id="102">
        <attributes>
            <attribute name="age" class="java.lang.Integer" >53</attribute>
        </attributes>
        <plan score="-0.38" selected="yes">
            <activity type="inside" link="81312" facility="outside_208" x="649324.9906891582" y="6866581.699995641" end_time="08:22:00" >
            </activity>
            <leg mode="bike" dep_time="08:22:00" trav_time="00:10:13">
                <route type="links" start_link="81312" end_link="138852" trav_time="00:10:13" distance="6046.54932060571" vehicleRefId="7262234">81312</route>
            </leg>
            <activity type="work" link="138852" facility="38407" x="651680.6" y="6863892.5" start_time="08:45:22" end_time="17:15:22" >
                <attributes>
                    <attribute name="innerParis" class="java.lang.Boolean" >true</attribute>
                </attributes>
            </activity>
            <leg mode="bike" dep_time="08:22:00" trav_time="00:10:13">
                <route type="links" start_link="81312" end_link="138852" trav_time="00:10:13" distance="6046.54932060571" vehicleRefId="7262234">81312</route>
            </leg>
            <activity type="work" link="138852" facility="38407" x="651680.6" y="6863892.5" start_time="08:45:22" end_time="17:15:22" >
                <attributes>
                    <attribute name="innerParis" class="java.lang.Boolean" >true</attribute>
                </attributes>
            </activity>
            <leg mode="pt" dep_time="17:15:22" trav_time="00:07:05">
                <route type="links" start_link="138852" end_link="189898" trav_time="00:07:05" distance="4604.544053407517" vehicleRefId="7262234">138852</route>
            </leg>
            <activity type="outside" link="189898" facility="outside_249" x="648729.9598002436" y="6866057.250182923" end_time="17:20:35" >
            </activity>
        </plan>
    </person>
    <person id="103">
        <attributes>
            <attribute name="age" class="java.lang.Integer" >53</attribute>
        </attributes>
        <plan score="-0.38" selected="yes">
            <activity type="inside" link="81312" facility="outside_208" x="649324.9906891582" y="6866581.699995641" end_time="08:22:00" >
            </activity>
            <leg mode="bike" dep_time="08:22:00" trav_time="00:10:13">
                <route type="links" start_link="81312" end_link="138852" trav_time="00:10:13" distance="6046.54932060571" vehicleRefId="7262234">81312</route>
            </leg>
            <activity type="shopping" link="138852" facility="38407" x="651680.6" y="6863892.5" start_time="08:45:22" end_time="17:15:22" >
                <attributes>
                    <attribute name="innerParis" class="java.lang.Boolean" >true</attribute>
                </attributes>
            </activity>
            <leg mode="bike" dep_time="08:22:00" trav_time="00:10:13">
                <route type="links" start_link="81312" end_link="138852" trav_time="00:10:13" distance="6046.54932060571" vehicleRefId="7262234">81312</route>
            </leg>
            <activity type="work" link="138852" facility="38407" x="651680.6" y="6863892.5" start_time="08:45:22" end_time="17:15:22" >
                <attributes>
                    <attribute name="innerParis" class="java.lang.Boolean" >true</attribute>
                </attributes>
            </activity>
            <leg mode="pt" dep_time="17:15:22" trav_time="00:07:05">
                <route type="links" start_link="138852" end_link="189898" trav_time="00:07:05" distance="4604.544053407517" vehicleRefId="7262234">138852</route>
            </leg>
            <activity type="outside" link="189898" facility="outside_249" x="648729.9598002436" y="6866057.250182923" end_time="17:20:35" >
            </activity>
        </plan>
    </person>
</population>

What I want is to extract the value of person id and in case plan selected ="yes" i further want to extract all activity type and leg mode .我想要的是提取person id的值，如果plan selected ="yes" ，我还想提取所有activity type和leg mode 。 It should be stored in the existing order as a dictionary for example (or data frame, it doesn't matter really).例如，它应该以现有顺序存储为字典（或数据框，这并不重要）。

So the ideal outcome would look like this:所以理想的结果应该是这样的：

id    leg_activity
101   outside; car; work; car; outside
102   inside; bike; work; bike; work ...
...

So far I've only worked with JMSPath and I know it is not the most suitable, so I'm happy to see other approaches with elementtree or so:) Also, I was unable to find a way to extract activity and leg information in one step.到目前为止，我只使用过 JMSPath，而且我知道它不是最合适的，所以我很高兴看到elementtree左右的其他方法：) 另外，我无法找到一种方法来提取activity和leg信息一步。 This is my approach so far:到目前为止，这是我的方法：

import gzip
import xmltodict
import pandas as pd
import jmespath

box = xmltodict.parse(gzip.open(gzipfile, 'r'))

expression = jmespath.compile('population.person[].plan[?"@selected"==`yes`].activity[*].["@type"]')

coords = expression.search(box)
coords = pd.DataFrame.from_dict(coords)

1 个解决方案

解决方案1
 3 已采纳  2020-05-29 12:59:01

Assuming that your xml is inside test.xml , the following should work:假设您的 xml 在test.xml内，以下应该可以工作：

from bs4 import BeautifulSoup
import pandas as pd
soup = BeautifulSoup(open('test.xml'), features='lxml')
plan_log = []
for person in soup.find_all('person'):
    log = {'id': person.get('id')}
    activities = []
    for plan in person.find_all('plan', attrs={'selected': 'yes'}):
        for detail in plan.children:
            if detail.name == 'activity':
                activities.append(detail.get('type'))
            elif detail.name == 'leg':
                activities.append(detail.get('mode'))
            # activities.append(detail.get('type') or detail.get('mode'))
    log['leg_activity'] = ', '.join(activities)
    plan_log.append(log)
df = pd.DataFrame(plan_log)
print(df)

Output: Output：

    id                                     leg_activity
0  101                 outside, car, work, car, outside
1  102      inside, bike, work, bike, work, pt, outside
2  103  inside, bike, shopping, bike, work, pt, outside

暂无
暂无

声明:本站的技术帖子网页，遵循CC BY-SA 4.0协议，如果您需要转载，请注明本站网址或者原文地址。任何问题请咨询:yoyou2525@163.com.

相关问题 如何使用Python从内部具有多个层次结构的json提取值 - How to extract values from json which has multiple hierarchies inside using Python 如何使用 Python 在多个节点上从 XML 有条件地提取数据？ - How to extract data from XML conditionally over multiple nodes using Python? 使用Python从XML文件中提取信息？ - Using Python to extract information from a XML file? 如何使用python从多个json文件中提取信息 - How to extract information from multiple json files using python 使用 Python 解析 XML 文件。 多重层次 - Parse XML file using Python. multiple hierarchies 使用 Python 从 xml 中的子节点导出信息 - Export information from child nodes in xml using Python 如何使用python解析XML层次结构？ - How to parse XML hierarchies with python? 来自多个包层次结构的 Python 日志记录（不使用根记录器） - Python logging from multiple package hierarchies (without using root logger) 如何使用json或xml格式的python从网页中提取信息？ - How to extract information from a web page using python in json or xml format? Python-从plist / xml提取信息 - Python - Extract information from plist/xml
相关标签
 
粤ICP备18138465号  © 2020-2024 STACKOOM.COM