將 Pandas 數據框轉換為嵌套的 json

Question

我有一個由 csv 文件制成的 Pandas Dataframe，我想將其轉換為自定義嵌套 JSON

    df = pd.read_csv("/content/analog.csv", sep=",")

數據框是這樣的：

datetime                key1    key2    key3        col1    col2    col3    ...  col100 
2020-08-27T02:28:00Z    WECP001 27001   con0000     1001    1002    1003    ...  1005   
2020-08-27T02:28:01Z    WECP001 27001   con0000     11      22      33      ...  99

我想將此 df 轉換為嵌套的 json，例如：

[ 
    {
       "datetime":"2020-08-27T02:28:00Z"
       "key1:"WECP001"
       "key2:"27001"
       "key3":"con0000"
       "DATA":{
               "col1":1001,
               "col2":1002,
               "col3":1003, 
               ...
               "col100":1005
              }
    },
    {
       "datetime":"2020-08-27T02:28:01Z"
       "key1:"WECP001"
       "key2:"27001"
       "key3":"con0000"
       "DATA":{
               "col1":11,
               "col2":22,
               "col3":33, 
               ...
               "col100":99
              }
    }
]

這是我累了的代碼，但我得到了錯誤的結果

cols = df.columns.difference(['datetime','key1','key2','key3'])
j = (df.groupby(['datetime','key1','key2','key3'])[cols]
       .apply(lambda x: x.to_dict('r'))
       .reset_index(name='DATA')
       .to_json(orient='records'))
print (j)

輸出是這樣的：

{
   "datetime":"2020-08-27T02:28:00Z"
   "key1:"WECP001"
   "key2:"27001"
   "key3":"con0000"
   "DATA":[{
           "col1":1001,
           "col2":1002,
           "col3":1003, 
           ...
           "col100
           }]

我的代碼的問題是“數據”部分變成了列表而不是字典感謝幫助

Answer 1

嘗試這個

df2 = df.iloc[:, :4]
df2['Data'] = df[[f'col{i}' for i in range(1, 4)]].to_dict(orient='records')
print(df2.to_json(orient='records'))

輸出：

[
  {
    "datetime": "2020-08-27T02:28:00Z",
    "key1": "WECP001",
    "key2": 27001,
    "key3": "con0000",
    "Data": {
      "col1": 1001,
      "col2": 1002,
      "col3": 1003
    }
  },
  {
    "datetime": "2020-08-27T02:28:01Z",
    "key1": "WECP001",
    "key2": 27001,
    "key3": "con0000",
    "Data": {
      "col1": 11,
      "col2": 22,
      "col3": 33
    }
  }
]

Answer 2

import pandas as pd

df = pd.read_csv("***abc.csv", sep=",")

df2 = df.iloc[:, :4]
df2['DATA'] = df.iloc[:, 5:].to_dict(orient='records')

print(df2.to_json(orient='records', lines=True))

結果：

{
   "datetime":"2020-08-27T02:28:00Z"
   "key1:"WECP001"
   "key2:"27001"
   "key3":"con0000"
   "DATA":{
           "col1":1001,
           "col2":1002,
           "col3":1003, 
           ...
           "col100": 
           }
}
{....}
{....}