[英]How can I convert a MultiIndex DataFrame to an object using list (eg dataclass)?
First, suppose you have the following DataFrame.首先,假设您有以下 DataFrame。
import pandas as ps
df = ps.DataFrame([
[0, 'test0', 0, 'sub0', 'one'],
[0, 'test0', 1, 'sub1', 'two'],
[1, 'test1', 0, 'sub0', 'one'],
[1, 'test1', 1, 'sub1', 'two'],
], columns=['id', 'name', 'sub_id', 'sub_name', 'value'])
df = df.set_index(['id', 'sub_id'])
name sub_name value
id sub_id
0 0 test0 sub0 one
1 test0 sub1 two
1 0 test1 sub0 one
1 test1 sub1 two
I want to convert this to a list object like the one below (Here we use dataclass).我想将其转换为如下所示的列表对象(这里我们使用数据类)。
from typing import List
from dataclasses import dataclass
@dataclass
class SubObj:
id: int
name: str
value: str
@dataclass
class MainObj:
id: int
name: str
sub_obj: List[SubObj]
The output should look like this:输出应如下所示:
result = [
MainObj(
id=0,
name='test0',
sub_obj=[
SubObj(
id=0,
name='sub0',
value='one'
),
SubObj(
id=1,
name='sub1',
value='two'
)
]
),
MainObj(
id=1,
name='test1',
sub_obj=[
SubObj(
id=0,
name='sub0',
value='one'
),
SubObj(
id=1,
name='sub1',
value='two'
)
]
),
]
print(result)
[MainObj(id=0, name='test0', sub_obj=[SubObj(id=0, name='sub0', value='one'), SubObj(id=1, name='sub1', value='two')]), MainObj(id=1, name='test1', sub_obj=[SubObj(id=0, name='sub0', value='one'), SubObj(id=1, name='sub1', value='two')])]
I want to implement it so that it outputs a list of MainObj with as short and easy-to-understand code as possible.我想实现它,以便它输出一个 MainObj 列表,其中包含尽可能短且易于理解的代码。
Do you know how to do it?你知道怎么做吗?
How about a little list comprehension like this?像这样的小列表理解怎么样?
result = [MainObj(
row[0][0],
row[1]['name'],
SubObj(
row[0][1],
row[1]['sub_name'],
row[1]['value']
)
) for row in df.iterrows()]
Returns退货
[MainObj(id=0, name='test0', sub_obj=SubObj(id=0, name='sub0', value='one')),
MainObj(id=0, name='test0', sub_obj=SubObj(id=1, name='sub1', value='two')),
MainObj(id=1, name='test1', sub_obj=SubObj(id=0, name='sub0', value='one')),
MainObj(id=1, name='test1', sub_obj=SubObj(id=1, name='sub1', value='two'))]
Update更新
Just realized you want sub_obj's as lists.刚刚意识到你想要 sub_obj's 作为列表。 I think this would be a better way:我认为这将是一个更好的方法:
results = list()
for _, g in df.groupby(level=0): # Groupby on first index
results.append(
MainObj(
g.index[0][0], # Get the first index value
g['name'].iloc[0],
[SubObj(row[0][1], row[1]['sub_name'], row[1]['value']) for row in g.iterrows()])) # List comp iterrating over group rows
[MainObj(id=0, name='test0', sub_obj=[SubObj(id=0, name='sub0', value='one'), SubObj(id=1, name='sub1', value='two')]),
MainObj(id=1, name='test1', sub_obj=[SubObj(id=0, name='sub0', value='one'), SubObj(id=1, name='sub1', value='two')])]
Here's a way to do it with pandas constructs这是一种使用 Pandas 构造的方法
SubObj
将行聚合到SubObj
sub_id
to create a dataframe that contains only the MainObj
level info删除sub_id
以创建仅包含MainObj
级别信息的数据帧MainObj
将行聚合到MainObj
>>> sub = df.reset_index('sub_id')[['sub_id', 'sub_name', 'value']].agg(lambda row: SubObj(*row), axis='columns')
>>> sub
id
0 SubObj(id=0, name='sub0', value='one')
0 SubObj(id=1, name='sub1', value='two')
1 SubObj(id=0, name='sub0', value='one')
1 SubObj(id=1, name='sub1', value='two')
>>> sub.groupby('id').agg(list)
id
0 [SubObj(id=0, name='sub0', value='one'), SubOb...
1 [SubObj(id=0, name='sub0', value='one'), SubOb...
Name: obj, dtype: object
>>> maindf = df[['name']].droplevel('sub_id').drop_duplicates().join(sub.groupby('id').agg(list))
>>> maindf
name obj
id
0 test0 [SubObj(id=0, name='sub0', value='one'), SubOb...
1 test1 [SubObj(id=0, name='sub0', value='one'), SubOb...
>>> maindf.reset_index().agg(lambda row: MainObj(*row), axis='columns').to_list()
[MainObj(id=0, name='test0', sub_obj=[SubObj(id=0, name='sub0', value='one'), SubObj(id=1, name='sub1', value='two')]), MainObj(id=1, name='test1', sub_obj=[SubObj(id=0, name='sub0', value='one'), SubObj(id=1, name='sub1', value='two')])]
声明:本站的技术帖子网页,遵循CC BY-SA 4.0协议,如果您需要转载,请注明本站网址或者原文地址。任何问题请咨询:yoyou2525@163.com.