[英]Python: Convert a JSON structure (including arrays) into a flat, denormalized structure
Given a JSON structure - including array on different levels, like in this example:给定一个 JSON 结构——包括不同级别的数组,如本例所示:
{
"listOfHouses": [
{
"name": "House Lannister",
"listOfMembers": [
{
"firstName": "Tywin",
"lastName": "Lannister"
},
{
"firstName": "Cersei",
"lastName": "Lannister"
}
]
},
{
"name": "House Targaryen",
"listOfMembers": [
{
"firstName": "Daenerys",
"lastName": "Targaryen"
}
]
}
]
}
I tried several approaches (eg using pd.json_normalize(...) or recursive tree algorithmus), but none of them returns result where each and every member of a house has its OWN entity in a converter structure.我尝试了几种方法(例如使用 pd.json_normalize(...) 或递归树算法),但它们都没有返回结果,其中房屋的每个成员在转换器结构中都有自己的实体。 I want the following converted structure:
我想要以下转换后的结构:
{
{
'name': 'House Lannister',
'firstName': 'Tywin',
'lastName': 'Lannister'
}, {
'name': 'House Lannister',
'firstName': 'Cersei',
'lastName': 'Lannister'
}, {
'name': 'House Targaryen',
'firstName': 'Daenerys',
'lastName': 'Targaryen'
}
}
Can this be implemented in Python in a generic way?这可以以通用方式在 Python 中实现吗?
Tried the following 2 approaches, both did not work to my satisfaction:尝试了以下两种方法,都没有让我满意:
import pandas as pd
import json
def flatten_json(y):
out = {}
def flatten(x, name=''):
if type(x) is dict:
for a in x:
flatten(x[a], name + a + '_')
elif type(x) is list:
i = 0
for a in x:
flatten(a, name + str(i) + '_')
i += 1
else:
out[name[:-1]] = x
flatten(y)
return out
if __name__ == '__main__':
with open('got-houses.json') as json_file:
data = json.load(json_file)
normalized_json = pd.json_normalize(data, 'listOfHouses')
print(normalized_json.to_string())
flattened_json = flatten_json(data['listOfHouses'])
print(flattened_json)
Output for pd.json_normalize: pd.json_normalize 的输出:
0 House Lannister [{'firstName': 'Tywin', 'lastName': 'Lannister'}, {'firstName': 'Cersei', 'lastName': 'Lannister'}]
1 House Targaryen [{'firstName': 'Daenerys', 'lastName': 'Targaryen'}]
Output for tree-walk:树行走的输出:
{
'0_name': 'House Lannister',
'0_listOfMembers_0_firstName': 'Tywin',
'0_listOfMembers_0_lastName': 'Lannister',
'0_listOfMembers_1_firstName': 'Cersei',
'0_listOfMembers_1_lastName': 'Lannister',
'1_name': 'House Targaryen',
'1_listOfMembers_0_firstName': 'Daenerys',
'1_listOfMembers_0_lastName': 'Targaryen'
}
I believe the below is what you are looking for.我相信以下是您正在寻找的。 (just a nested loop)
(只是一个嵌套循环)
data = {
"listOfHouses": [
{
"name": "House Lannister",
"listOfMembers": [
{
"firstName": "Tywin",
"lastName": "Lannister"
},
{
"firstName": "Cersei",
"lastName": "Lannister"
}
]
},
{
"name": "House Targaryen",
"listOfMembers": [
{
"firstName": "Daenerys",
"lastName": "Targaryen"
}
]
}
]
}
output = []
for entry in data['listOfHouses']:
for sub in entry['listOfMembers']:
output.append({'name': entry['name'], 'firstName': sub['firstName'], 'lastName': sub['lastName']})
print(output)
output输出
[{'name': 'House Lannister', 'firstName': 'Tywin', 'lastName': 'Lannister'}, {'name': 'House Lannister', 'firstName': 'Cersei', 'lastName': 'Lannister'}, {'name': 'House Targaryen', 'firstName': 'Daenerys', 'lastName': 'Targaryen'}]
声明:本站的技术帖子网页,遵循CC BY-SA 4.0协议,如果您需要转载,请注明本站网址或者原文地址。任何问题请咨询:yoyou2525@163.com.