[英]CSV to nested JSON using Python/pandas
我正在嘗試將平面CSV轉換為嵌套JSON格式。 這是我的數據:
# data.csv
company_id,company_name,income_type,income_amt
1,"Foobar Inc","royalties",5000000
2,"ACME Corp","sales",3000000
2,"ACME Corp","rent",1000000
並且需要轉換為以下JSON結構:
{"data": [{
"company_id": 1,
"name": "Foobar Inc",
"income": ["royalties": 5000000]
},
{
"company_id": 2,
"company_name": "ACME Corp",
"income": [
"sales": 3000000,
"rent": 1000000
]
}]
}
但是我當前的代碼(基於此,並使用Python和pandas庫):
# script.py
import json
import pandas as pd
df = pd.read_csv('data.csv')
def get_nested_rec(key, grp):
rec = {}
rec['company_id'] = key[0]
rec['company_name'] = key[1]
for field in ['income_type']:
income_types = list(grp[field].unique())
rec['income'] = income_types
return rec
records = []
for key, grp in df.groupby(['company_id','company_name','income_type','income_amt']):
rec = get_nested_rec(key, grp)
records.append(rec)
records = dict(data = records)
print(json.dumps(records, indent=4))
輸出以下格式:
{"data": [
{
"company_id": 1,
"company_name": "Foobar Inc",
"income": [
"royalties"
]
},
{
"company_id": 2,
"company_name": "ACME Corp",
"income": [
"sales"
]
},
{
"company_id": 2,
"company_name": "ACME Corp",
"income": [
"rent"
]
}
]}
弄清楚如何將具有相同company_id
行合並到單個對象中,並添加income_amt
值。
您可以這樣做:
for key, grp in df.groupby('company_id'):
records.append({
"company_id": key,
"company_name": grp.company_name.iloc[0],
"income": {
row.income_type: row.income_amt for row in grp.itertuples()
}})
那給你:
[{'company_id': 1,
'company_name': 'Foobar Inc',
'income': {'royalties': 5000000}},
{'company_id': 2,
'company_name': 'ACME Corp',
'income': {'rent': 1000000, 'sales': 3000000}}]
聲明:本站的技術帖子網頁,遵循CC BY-SA 4.0協議,如果您需要轉載,請注明本站網址或者原文地址。任何問題請咨詢:yoyou2525@163.com.