如何在pandas数据帧中读取mongodb导出的Json

Question

I'm using the following code to export a json from a mongoDB query:

 querywith open(r'/Month/Applications_test.json', 'w') as f:
for x in dic:
    json.dump(x, f, default=json_util.default)

That is working well and is returning the following json:

{
  "_class": "Application",
  "_id": "123",
  "applicationTimeStamp": {
    "$date": 1541466008000
  },
  "createdDateTime": {
    "$date": 1541466008084
  }
}
{
  "_class": "Application",
  "_id": "124",
  "applicationTimeStamp": {
    "$date": 1540080000000
  },
  "createdDateTime": {
    "$date": 1540080000096
  }
}
{
  "_class": "Application",
  "_id": "125",
  "applicationTimeStamp": {
    "$date": 1540080000000
  },
  "createdDateTime": {
    "$date": 1540080000097
  }
}

I'm using the following pandas code to try to read it:

data_df = pd.read_json(r'/Month/Applications_test.json', lines = True)

I'm getting the following error:

ValueError: Unexpected character found when decoding array value (2)

What I want is a pandas dataframe that has:

_class      | _id | applicationTimeStamp | createdDateTime
Application | 123 | 10/07/2018           | 10/07/2018
Application | 124 | 10/07/2018           | 10/07/2018
Application | 125 | 10/07/2018           | 10/07/2018

How could I read the json above into a pandas dataframe?

Thank you!

Answer 1

you have to use read_json in this way:

df = pd.read_json(path_or_buf="file_path\json.txt",  typ='frame')

it returns a dataframe like:

            _class  _id  applicationTimeStamp  createdDateTime
$date  Application  123         1541466008000    1541466008084

or:

        _class            ...                      createdDateTime
0  Application            ...             {'$date': 1541466008084}
1  Application            ...             {'$date': 1540080000096}
2  Application            ...             {'$date': 1540000000097}

then you can convert timestamp.