簡體   English   中英

python json轉csv,csv重復循環寫入

[英]python json to csv,csv repeat loop write

I need to convert a large JSON file into a csv file and read it line by line, but the code will write to the csv file in a loop, the output of the 10MB JSON file gets a 1GB csv file, and the csv file is還在增加,代碼運行后只能手動停止。

我的代碼

import pandas as pd
import json
all_data = []
with open('G:\\1.json',encoding='utf-8') as f_json:
    for line in f_json:
        line = line.strip()
        if line:
            all_data.append(json.loads(line))
            df = pd.json_normalize(all_data)
            df.to_csv('G:\\1.csv', index=None,encoding='utf-8', mode='a')


我的 JSON 文件

{"_index":"core-bvd-dmc","_type":"_doc","_id":"e22762d5c4b81fbcad62b5c1d77226ec","_score":1,"_source":{"a_id":"P305906272","a_id_type":"Contact ID","a_name":"Mr Chuanzong Chen","a_name_normal":"MR CHUANZONG CHEN","a_job_title":"Executive director and general manager","relationship":"Currently works for (Executive director and general manager)","b_id":"CN9390051924","b_id_type":"BVD ID","b_name":"Yantai haofeng trade co., ltd.","b_name_normal":"YANTAI HAOFENG TRADE CO","b_country_code":"CN","b_country":"China","b_in_compliance_db":false,"b_nationality":"CN","b_street_address":"Bei da jie 53hao 1609shi; Zhi fu qu","b_city":"Yantai","b_postcode":"264000","b_region":"East China|Shandong","b_phone":"+86 18354522200","b_email":"18354522200@163.com","b_latitude":37.511873,"b_longitude":121.396883,"b_geo_accuracy":"Community","b_national_ids":{"Unified social credit code":["91370602073035263P"],"Trade register number":["370602200112047"],"NOC":["073035263"]},"dates":{"date_of_birth":null},"file_name":"/media/hedwig/iforce/data/BvD/s3-transfer/SuperTable_v3_json/dmc/part-00020-7b09c546-2adc-413e-9e68-18b300e205cf-c000.json","b_geo_point":{"lat":37.511873,"lon":121.396883}}}

output CSV

_index,_type,_id,_score,_source.a_id,_source.a_id_type,_source.a_name,_source.a_name_normal,_source.a_job_title,_source.relationship,_source.b_id,_source.b_id_type,_source.b_name,_source.b_name_normal,_source.b_country_code,_source.b_country,_source.b_in_compliance_db,_source.b_nationality,_source.b_street_address,_source.b_city,_source.b_postcode,_source.b_region,_source.b_phone,_source.b_email,_source.b_latitude,_source.b_longitude,_source.b_geo_accuracy,_source.b_national_ids.Unified social credit code,_source.b_national_ids.Trade register number,_source.b_national_ids.NOC,_source.dates.date_of_birth,_source.file_name,_source.b_geo_point.lat,_source.b_geo_point.lon
core-bvd-dmc,_doc,e22762d5c4b81fbcad62b5c1d77226ec,1,P305906272,Contact ID,Mr Chuanzong Chen,MR CHUANZONG CHEN,Executive director and general manager,Currently works for (Executive director and general manager),CN9390051924,BVD ID,"Yantai haofeng trade co., ltd.",YANTAI HAOFENG TRADE CO,CN,China,False,CN,Bei da jie 53hao 1609shi; Zhi fu qu,Yantai,264000,East China|Shandong,+86 18354522200,18354522200@163.com,37.511873,121.396883,Community,['91370602073035263P'],['370602200112047'],['073035263'],,/media/hedwig/iforce/data/BvD/s3-transfer/SuperTable_v3_json/dmc/part-00020-7b09c546-2adc-413e-9e68-18b300e205cf-c000.json,37.511873,121.396883
_index,_type,_id,_score,_source.a_id,_source.a_id_type,_source.a_name,_source.a_name_normal,_source.a_job_title,_source.relationship,_source.b_id,_source.b_id_type,_source.b_name,_source.b_name_normal,_source.b_country_code,_source.b_country,_source.b_in_compliance_db,_source.b_nationality,_source.b_street_address,_source.b_city,_source.b_postcode,_source.b_region,_source.b_phone,_source.b_email,_source.b_latitude,_source.b_longitude,_source.b_geo_accuracy,_source.b_national_ids.Unified social credit code,_source.b_national_ids.Trade register number,_source.b_national_ids.NOC,_source.dates.date_of_birth,_source.file_name,_source.b_geo_point.lat,_source.b_geo_point.lon
core-bvd-dmc,_doc,e22762d5c4b81fbcad62b5c1d77226ec,1,P305906272,Contact ID,Mr Chuanzong Chen,MR CHUANZONG CHEN,Executive director and general manager,Currently works for (Executive director and general manager),CN9390051924,BVD ID,"Yantai haofeng trade co., ltd.",YANTAI HAOFENG TRADE CO,CN,China,False,CN,Bei da jie 53hao 1609shi; Zhi fu qu,Yantai,264000,East China|Shandong,+86 18354522200,18354522200@163.com,37.511873,121.396883,Community,['91370602073035263P'],['370602200112047'],['073035263'],,/media/hedwig/iforce/data/BvD/s3-transfer/SuperTable_v3_json/dmc/part-00020-7b09c546-2adc-413e-9e68-18b300e205cf-c000.json,37.511873,121.396883
core-bvd-dmc,_doc,e22762d5c4b81fbcad62b5c1d77226ec,1,P305906272,Contact ID,Mr Chuanzong Chen,MR CHUANZONG CHEN,Executive director and general manager,Currently works for (Executive director and general manager),CN9390051924,BVD ID,"Yantai haofeng trade co., ltd.",YANTAI HAOFENG TRADE CO,CN,China,False,CN,Bei da jie 53hao 1609shi; Zhi fu qu,Yantai,264000,East China|Shandong,+86 18354522200,18354522200@163.com,37.511873,121.396883,Community,['91370602073035263P'],['370602200112047'],['073035263'],,/media/hedwig/iforce/data/BvD/s3-transfer/SuperTable_v3_json/dmc/part-00020-7b09c546-2adc-413e-9e68-18b300e205cf-c000.json,37.511873,121.396883
_index,_type,_id,_score,_source.a_id,_source.a_id_type,_source.a_name,_source.a_name_normal,_source.a_job_title,_source.relationship,_source.b_id,_source.b_id_type,_source.b_name,_source.b_name_normal,_source.b_country_code,_source.b_country,_source.b_in_compliance_db,_source.b_nationality,_source.b_street_address,_source.b_city,_source.b_postcode,_source.b_region,_source.b_phone,_source.b_email,_source.b_latitude,_source.b_longitude,_source.b_geo_accuracy,_source.b_national_ids.Unified social credit code,_source.b_national_ids.Trade register number,_source.b_national_ids.NOC,_source.dates.date_of_birth,_source.file_name,_source.b_geo_point.lat,_source.b_geo_point.lon
core-bvd-dmc,_doc,e22762d5c4b81fbcad62b5c1d77226ec,1,P305906272,Contact ID,Mr Chuanzong Chen,MR CHUANZONG CHEN,Executive director and general manager,Currently works for (Executive director and general manager),CN9390051924,BVD ID,"Yantai haofeng trade co., ltd.",YANTAI HAOFENG TRADE CO,CN,China,False,CN,Bei da jie 53hao 1609shi; Zhi fu qu,Yantai,264000,East China|Shandong,+86 18354522200,18354522200@163.com,37.511873,121.396883,Community,['91370602073035263P'],['370602200112047'],['073035263'],,/media/hedwig/iforce/data/BvD/s3-transfer/SuperTable_v3_json/dmc/part-00020-7b09c546-2adc-413e-9e68-18b300e205cf-c000.json,37.511873,121.396883
core-bvd-dmc,_doc,e22762d5c4b81fbcad62b5c1d77226ec,1,P305906272,Contact ID,Mr Chuanzong Chen,MR CHUANZONG CHEN,Executive director and general manager,Currently works for (Executive director and general manager),CN9390051924,BVD ID,"Yantai haofeng trade co., ltd.",YANTAI HAOFENG TRADE CO,CN,China,False,CN,Bei da jie 53hao 1609shi; Zhi fu qu,Yantai,264000,East China|Shandong,+86 18354522200,18354522200@163.com,37.511873,121.396883,Community,['91370602073035263P'],['370602200112047'],['073035263'],,/media/hedwig/iforce/data/BvD/s3-transfer/SuperTable_v3_json/dmc/part-00020-7b09c546-2adc-413e-9e68-18b300e205cf-c000.json,37.511873,121.396883
core-bvd-dmc,_doc,e22762d5c4b81fbcad62b5c1d77226ec,1,P305906272,Contact ID,Mr Chuanzong Chen,MR CHUANZONG CHEN,Executive director and general manager,Currently works for (Executive director and general manager),CN9390051924,BVD ID,"Yantai haofeng trade co., ltd.",YANTAI HAOFENG TRADE CO,CN,China,False,CN,Bei da jie 53hao 1609shi; Zhi fu qu,Yantai,264000,East China|Shandong,+86 18354522200,18354522200@163.com,37.511873,121.396883,Community,['91370602073035263P'],['370602200112047'],['073035263'],,/media/hedwig/iforce/data/BvD/s3-transfer/SuperTable_v3_json/dmc/part-00020-7b09c546-2adc-413e-9e68-18b300e205cf-c000.json,37.511873,121.396883
_index,_type,_id,_score,_source.a_id,_source.a_id_type,_source.a_name,_source.a_name_normal,_source.a_job_title,_source.relationship,_source.b_id,_source.b_id_type,_source.b_name,_source.b_name_normal,_source.b_country_code,_source.b_country,_source.b_in_compliance_db,_source.b_nationality,_source.b_street_address,_source.b_city,_source.b_postcode,_source.b_region,_source.b_phone,_source.b_email,_source.b_latitude,_source.b_longitude,_source.b_geo_accuracy,_source.b_national_ids.Unified social credit code,_source.b_national_ids.Trade register number,_source.b_national_ids.NOC,_source.dates.date_of_birth,_source.file_name,_source.b_geo_point.lat,_source.b_geo_point.lon
core-bvd-dmc,_doc,e22762d5c4b81fbcad62b5c1d77226ec,1,P305906272,Contact ID,Mr Chuanzong Chen,MR CHUANZONG CHEN,Executive director and general manager,Currently works for (Executive director and general manager),CN9390051924,BVD ID,"Yantai haofeng trade co., ltd.",YANTAI HAOFENG TRADE CO,CN,China,False,CN,Bei da jie 53hao 1609shi; Zhi fu qu,Yantai,264000,East China|Shandong,+86 18354522200,18354522200@163.com,37.511873,121.396883,Community,['91370602073035263P'],['370602200112047'],['073035263'],,/media/hedwig/iforce/data/BvD/s3-transfer/SuperTable_v3_json/dmc/part-00020-7b09c546-2adc-413e-9e68-18b300e205cf-c000.json,37.511873,121.396883
core-bvd-dmc,_doc,e22762d5c4b81fbcad62b5c1d77226ec,1,P305906272,Contact ID,Mr Chuanzong Chen,MR CHUANZONG CHEN,Executive director and general manager,Currently works for (Executive director and general manager),CN9390051924,BVD ID,"Yantai haofeng trade co., ltd.",YANTAI HAOFENG TRADE CO,CN,China,False,CN,Bei da jie 53hao 1609shi; Zhi fu qu,Yantai,264000,East China|Shandong,+86 18354522200,18354522200@163.com,37.511873,121.396883,Community,['91370602073035263P'],['370602200112047'],['073035263'],,/media/hedwig/iforce/data/BvD/s3-transfer/SuperTable_v3_json/dmc/part-00020-7b09c546-2adc-413e-9e68-18b300e205cf-c000.json,37.511873,121.396883
core-bvd-dmc,_doc,e22762d5c4b81fbcad62b5c1d77226ec,1,P305906272,Contact ID,Mr Chuanzong Chen,MR CHUANZONG CHEN,Executive director and general manager,Currently works for (Executive director and general manager),CN9390051924,BVD ID,"Yantai haofeng trade co., ltd.",YANTAI HAOFENG TRADE CO,CN,China,False,CN,Bei da jie 53hao 1609shi; Zhi fu qu,Yantai,264000,East China|Shandong,+86 18354522200,18354522200@163.com,37.511873,121.396883,Community,['91370602073035263P'],['370602200112047'],['073035263'],,/media/hedwig/iforce/data/BvD/s3-transfer/SuperTable_v3_json/dmc/part-00020-7b09c546-2adc-413e-9e68-18b300e205cf-c000.json,37.511873,121.396883
core-bvd-dmc,_doc,e22762d5c4b81fbcad62b5c1d77226ec,1,P305906272,Contact ID,Mr Chuanzong Chen,MR CHUANZONG CHEN,Executive director and general manager,Currently works for (Executive director and general manager),CN9390051924,BVD ID,"Yantai haofeng trade co., ltd.",YANTAI HAOFENG TRADE CO,CN,China,False,CN,Bei da jie 53hao 1609shi; Zhi fu qu,Yantai,264000,East China|Shandong,+86 18354522200,18354522200@163.com,37.511873,121.396883,Community,['91370602073035263P'],['370602200112047'],['073035263'],,/media/hedwig/iforce/data/BvD/s3-transfer/SuperTable_v3_json/dmc/part-00020-7b09c546-2adc-413e-9e68-18b300e205cf-c000.json,37.511873,121.396883
_index,_type,_id,_score,_source.a_id,_source.a_id_type,_source.a_name,_source.a_name_normal,_source.a_job_title,_source.relationship,_source.b_id,_source.b_id_type,_source.b_name,_source.b_name_normal,_source.b_country_code,_source.b_country,_source.b_in_compliance_db,_source.b_nationality,_source.b_street_address,_source.b_city,_source.b_postcode,_source.b_region,_source.b_phone,_source.b_email,_source.b_latitude,_source.b_longitude,_source.b_geo_accuracy,_source.b_national_ids.Unified social credit code,_source.b_national_ids.Trade register number,_source.b_national_ids.NOC,_source.dates.date_of_birth,_source.file_name,_source.b_geo_point.lat,_source.b_geo_point.lon
core-bvd-dmc,_doc,e22762d5c4b81fbcad62b5c1d77226ec,1,P305906272,Contact ID,Mr Chuanzong Chen,MR CHUANZONG CHEN,Executive director and general manager,Currently works for (Executive director and general manager),CN9390051924,BVD ID,"Yantai haofeng trade co., ltd.",YANTAI HAOFENG TRADE CO,CN,China,False,CN,Bei da jie 53hao 1609shi; Zhi fu qu,Yantai,264000,East China|Shandong,+86 18354522200,18354522200@163.com,37.511873,121.396883,Community,['91370602073035263P'],['370602200112047'],['073035263'],,/media/hedwig/iforce/data/BvD/s3-transfer/SuperTable_v3_json/dmc/part-00020-7b09c546-2adc-413e-9e68-18b300e205cf-c000.json,37.511873,121.396883
core-bvd-dmc,_doc,e22762d5c4b81fbcad62b5c1d77226ec,1,P305906272,Contact ID,Mr Chuanzong Chen,MR CHUANZONG CHEN,Executive director and general manager,Currently works for (Executive director and general manager),CN9390051924,BVD ID,"Yantai haofeng trade co., ltd.",YANTAI HAOFENG TRADE CO,CN,China,False,CN,Bei da jie 53hao 1609shi; Zhi fu qu,Yantai,264000,East China|Shandong,+86 18354522200,18354522200@163.com,37.511873,121.396883,Community,['91370602073035263P'],['370602200112047'],['073035263'],,/media/hedwig/iforce/data/BvD/s3-transfer/SuperTable_v3_json/dmc/part-00020-7b09c546-2adc-413e-9e68-18b300e205cf-c000.json,37.511873,121.396883
core-bvd-dmc,_doc,e22762d5c4b81fbcad62b5c1d77226ec,1,P305906272,Contact ID,Mr Chuanzong Chen,MR CHUANZONG CHEN,Executive director and general manager,Currently works for (Executive director and general manager),CN9390051924,BVD ID,"Yantai haofeng trade co., ltd.",YANTAI HAOFENG TRADE CO,CN,China,False,CN,Bei da jie 53hao 1609shi; Zhi fu qu,Yantai,264000,East China|Shandong,+86 18354522200,18354522200@163.com,37.511873,121.396883,Community,['91370602073035263P'],['370602200112047'],['073035263'],,/media/hedwig/iforce/data/BvD/s3-transfer/SuperTable_v3_json/dmc/part-00020-7b09c546-2adc-413e-9e68-18b300e205cf-c000.json,37.511873,121.396883
core-bvd-dmc,_doc,e22762d5c4b81fbcad62b5c1d77226ec,1,P305906272,Contact ID,Mr Chuanzong Chen,MR CHUANZONG CHEN,Executive director and general manager,Currently works for (Executive director and general manager),CN9390051924,BVD ID,"Yantai haofeng trade co., ltd.",YANTAI HAOFENG TRADE CO,CN,China,False,CN,Bei da jie 53hao 1609shi; Zhi fu qu,Yantai,264000,East China|Shandong,+86 18354522200,18354522200@163.com,37.511873,121.396883,Community,['91370602073035263P'],['370602200112047'],['073035263'],,/media/hedwig/iforce/data/BvD/s3-transfer/SuperTable_v3_json/dmc/part-00020-7b09c546-2adc-413e-9e68-18b300e205cf-c000.json,37.511873,121.396883
core-bvd-dmc,_doc,e22762d5c4b81fbcad62b5c1d77226ec,1,P305906272,Contact ID,Mr Chuanzong Chen,MR CHUANZONG CHEN,Executive director and general manager,Currently works for (Executive director and general manager),CN9390051924,BVD ID,"Yantai haofeng trade co., ltd.",YANTAI HAOFENG TRADE CO,CN,China,False,CN,Bei da jie 53hao 1609shi; Zhi fu qu,Yantai,264000,East China|Shandong,+86 18354522200,18354522200@163.com,37.511873,121.396883,Community,['91370602073035263P'],['370602200112047'],['073035263'],,/media/hedwig/iforce/data/BvD/s3-transfer/SuperTable_v3_json/dmc/part-00020-7b09c546-2adc-413e-9e68-18b300e205cf-c000.json,37.511873,121.396883
_index,_type,_id,_score,_source.a_id,_source.a_id_type,_source.a_name,_source.a_name_normal,_source.a_job_title,_source.relationship,_source.b_id,_source.b_id_type,_source.b_name,_source.b_name_normal,_source.b_country_code,_source.b_country,_source.b_in_compliance_db,_source.b_nationality,_source.b_street_address,_source.b_city,_source.b_postcode,_source.b_region,_source.b_phone,_source.b_email,_source.b_latitude,_source.b_longitude,_source.b_geo_accuracy,_source.b_national_ids.Unified social credit code,_source.b_national_ids.Trade register number,_source.b_national_ids.NOC,_source.dates.date_of_birth,_source.file_name,_source.b_geo_point.lat,_source.b_geo_point.lon
core-bvd-dmc,_doc,e22762d5c4b81fbcad62b5c1d77226ec,1,P305906272,Contact ID,Mr Chuanzong Chen,MR CHUANZONG CHEN,Executive director and general manager,Currently works for (Executive director and general manager),CN9390051924,BVD ID,"Yantai haofeng trade co., ltd.",YANTAI HAOFENG TRADE CO,CN,China,False,CN,Bei da jie 53hao 1609shi; Zhi fu qu,Yantai,264000,East China|Shandong,+86 18354522200,18354522200@163.com,37.511873,121.396883,Community,['91370602073035263P'],['370602200112047'],['073035263'],,/media/hedwig/iforce/data/BvD/s3-transfer/SuperTable_v3_json/dmc/part-00020-7b09c546-2adc-413e-9e68-18b300e205cf-c000.json,37.511873,121.396883
core-bvd-dmc,_doc,e22762d5c4b81fbcad62b5c1d77226ec,1,P305906272,Contact ID,Mr Chuanzong Chen,MR CHUANZONG CHEN,Executive director and general manager,Currently works for (Executive director and general manager),CN9390051924,BVD ID,"Yantai haofeng trade co., ltd.",YANTAI HAOFENG TRADE CO,CN,China,False,CN,Bei da jie 53hao 1609shi; Zhi fu qu,Yantai,264000,East China|Shandong,+86 18354522200,18354522200@163.com,37.511873,121.396883,Community,['91370602073035263P'],['370602200112047'],['073035263'],,/media/hedwig/iforce/data/BvD/s3-transfer/SuperTable_v3_json/dmc/part-00020-7b09c546-2adc-413e-9e68-18b300e205cf-c000.json,37.511873,121.396883
core-bvd-dmc,_doc,e22762d5c4b81fbcad62b5c1d77226ec,1,P305906272,Contact ID,Mr Chuanzong Chen,MR CHUANZONG CHEN,Executive director and general manager,Currently works for (Executive director and general manager),CN9390051924,BVD ID,"Yantai haofeng trade co., ltd.",YANTAI HAOFENG TRADE CO,CN,China,False,CN,Bei da jie 53hao 1609shi; Zhi fu qu,Yantai,264000,East China|Shandong,+86 18354522200,18354522200@163.com,37.511873,121.396883,Community,['91370602073035263P'],['370602200112047'],['073035263'],,/media/hedwig/iforce/data/BvD/s3-transfer/SuperTable_v3_json/dmc/part-00020-7b09c546-2adc-413e-9e68-18b300e205cf-c000.json,37.511873,121.396883
core-bvd-dmc,_doc,e22762d5c4b81fbcad62b5c1d77226ec,1,P305906272,Contact ID,Mr Chuanzong Chen,MR CHUANZONG CHEN,Executive director and general manager,Currently works for (Executive director and general manager),CN9390051924,BVD ID,"Yantai haofeng trade co., ltd.",YANTAI HAOFENG TRADE CO,CN,China,False,CN,Bei da jie 53hao 1609shi; Zhi fu qu,Yantai,264000,East China|Shandong,+86 18354522200,18354522200@163.com,37.511873,121.396883,Community,['91370602073035263P'],['370602200112047'],['073035263'],,/media/hedwig/iforce/data/BvD/s3-transfer/SuperTable_v3_json/dmc/part-00020-7b09c546-2adc-413e-9e68-18b300e205cf-c000.json,37.511873,121.396883
core-bvd-dmc,_doc,e22762d5c4b81fbcad62b5c1d77226ec,1,P305906272,Contact ID,Mr Chuanzong Chen,MR CHUANZONG CHEN,Executive director and general manager,Currently works for (Executive director and general manager),CN9390051924,BVD ID,"Yantai haofeng trade co., ltd.",YANTAI HAOFENG TRADE CO,CN,China,False,CN,Bei da jie 53hao 1609shi; Zhi fu qu,Yantai,264000,East China|Shandong,+86 18354522200,18354522200@163.com,37.511873,121.396883,Community,['91370602073035263P'],['370602200112047'],['073035263'],,/media/hedwig/iforce/data/BvD/s3-transfer/SuperTable_v3_json/dmc/part-00020-7b09c546-2adc-413e-9e68-18b300e205cf-c000.json,37.511873,121.396883
core-bvd-dmc,_doc,e22762d5c4b81fbcad62b5c1d77226ec,1,P305906272,Contact ID,Mr Chuanzong Chen,MR CHUANZONG CHEN,Executive director and general manager,Currently works for (Executive director and general manager),CN9390051924,BVD ID,"Yantai haofeng trade co., ltd.",YANTAI HAOFENG TRADE CO,CN,China,False,CN,Bei da jie 53hao 1609shi; Zhi fu qu,Yantai,264000,East China|Shandong,+86 18354522200,18354522200@163.com,37.511873,121.396883,Community,['91370602073035263P'],['370602200112047'],['073035263'],,/media/hedwig/iforce/data/BvD/s3-transfer/SuperTable_v3_json/dmc/part-00020-7b09c546-2adc-413e-9e68-18b300e205cf-c000.json,37.511873,121.396883
_index,_type,_id,_score,_source.a_id,_source.a_id_type,_source.a_name,_source.a_name_normal,_source.a_job_title,_source.relationship,_source.b_id,_source.b_id_type,_source.b_name,_source.b_name_normal,_source.b_country_code,_source.b_country,_source.b_in_compliance_db,_source.b_nationality,_source.b_street_address,_source.b_city,_source.b_postcode,_source.b_region,_source.b_phone,_source.b_email,_source.b_latitude,_source.b_longitude,_source.b_geo_accuracy,_source.b_national_ids.Unified social credit code,_source.b_national_ids.Trade register number,_source.b_national_ids.NOC,_source.dates.date_of_birth,_source.file_name,_source.b_geo_point.lat,_source.b_geo_point.lon
core-bvd-dmc,_doc,e22762d5c4b81fbcad62b5c1d77226ec,1,P305906272,Contact ID,Mr Chuanzong Chen,MR CHUANZONG CHEN,Executive director and general manager,Currently works for (Executive director and general manager),CN9390051924,BVD ID,"Yantai haofeng trade co., ltd.",YANTAI HAOFENG TRADE CO,CN,China,False,CN,Bei da jie 53hao 1609shi; Zhi fu qu,Yantai,264000,East China|Shandong,+86 18354522200,18354522200@163.com,37.511873,121.396883,Community,['91370602073035263P'],['370602200112047'],['073035263'],,/media/hedwig/iforce/data/BvD/s3-transfer/SuperTable_v3_json/dmc/part-00020-7b09c546-2adc-413e-9e68-18b300e205cf-c000.json,37.511873,121.396883
core-bvd-dmc,_doc,e22762d5c4b81fbcad62b5c1d77226ec,1,P305906272,Contact ID,Mr Chuanzong Chen,MR CHUANZONG CHEN,Executive director and general manager,Currently works for (Executive director and general manager),CN9390051924,BVD ID,"Yantai haofeng trade co., ltd.",YANTAI HAOFENG TRADE CO,CN,China,False,CN,Bei da jie 53hao 1609shi; Zhi fu qu,Yantai,264000,East China|Shandong,+86 18354522200,18354522200@163.com,37.511873,121.396883,Community,['91370602073035263P'],['370602200112047'],['073035263'],,/media/hedwig/iforce/data/BvD/s3-transfer/SuperTable_v3_json/dmc/part-00020-7b09c546-2adc-413e-9e68-18b300e205cf-c000.json,37.511873,121.396883
core-bvd-dmc,_doc,e22762d5c4b81fbcad62b5c1d77226ec,1,P305906272,Contact ID,Mr Chuanzong Chen,MR CHUANZONG CHEN,Executive director and general manager,Currently works for (Executive director and general manager),CN9390051924,BVD ID,"Yantai haofeng trade co., ltd.",YANTAI HAOFENG TRADE CO,CN,China,False,CN,Bei da jie 53hao 1609shi; Zhi fu qu,Yantai,264000,East China|Shandong,+86 18354522200,18354522200@163.com,37.511873,121.396883,Community,['91370602073035263P'],['370602200112047'],['073035263'],,/media/hedwig/iforce/data/BvD/s3-transfer/SuperTable_v3_json/dmc/part-00020-7b09c546-2adc-413e-9e68-18b300e205cf-c000.json,37.511873,121.396883
core-bvd-dmc,_doc,e22762d5c4b81fbcad62b5c1d77226ec,1,P305906272,Contact ID,Mr Chuanzong Chen,MR CHUANZONG CHEN,Executive director and general manager,Currently works for (Executive director and general manager),CN9390051924,BVD ID,"Yantai haofeng trade co., ltd.",YANTAI HAOFENG TRADE CO,CN,China,False,CN,Bei da jie 53hao 1609shi; Zhi fu qu,Yantai,264000,East China|Shandong,+86 18354522200,18354522200@163.com,37.511873,121.396883,Community,['91370602073035263P'],['370602200112047'],['073035263'],,/media/hedwig/iforce/data/BvD/s3-transfer/SuperTable_v3_json/dmc/part-00020-7b09c546-2adc-413e-9e68-18b300e205cf-c000.json,37.511873,121.396883
core-bvd-dmc,_doc,e22762d5c4b81fbcad62b5c1d77226ec,1,P305906272,Contact ID,Mr Chuanzong Chen,MR CHUANZONG CHEN,Executive director and general manager,Currently works for (Executive director and general manager),CN9390051924,BVD ID,"Yantai haofeng trade co., ltd.",YANTAI HAOFENG TRADE CO,CN,China,False,CN,Bei da jie 53hao 1609shi; Zhi fu qu,Yantai,264000,East China|Shandong,+86 18354522200,18354522200@163.com,37.511873,121.396883,Community,['91370602073035263P'],['370602200112047'],['073035263'],,/media/hedwig/iforce/data/BvD/s3-transfer/SuperTable_v3_json/dmc/part-00020-7b09c546-2adc-413e-9e68-18b300e205cf-c000.json,37.511873,121.396883
core-bvd-dmc,_doc,e22762d5c4b81fbcad62b5c1d77226ec,1,P305906272,Contact ID,Mr Chuanzong Chen,MR CHUANZONG CHEN,Executive director and general manager,Currently works for (Executive director and general manager),CN9390051924,BVD ID,"Yantai haofeng trade co., ltd.",YANTAI HAOFENG TRADE CO,CN,China,False,CN,Bei da jie 53hao 1609shi; Zhi fu qu,Yantai,264000,East China|Shandong,+86 18354522200,18354522200@163.com,37.511873,121.396883,Community,['91370602073035263P'],['370602200112047'],['073035263'],,/media/hedwig/iforce/data/BvD/s3-transfer/SuperTable_v3_json/dmc/part-00020-7b09c546-2adc-413e-9e68-18b300e205cf-c000.json,37.511873,121.396883
core-bvd-dmc,_doc,e22762d5c4b81fbcad62b5c1d77226ec,1,P305906272,Contact ID,Mr Chuanzong Chen,MR CHUANZONG CHEN,Executive director and general manager,Currently works for (Executive director and general manager),CN9390051924,BVD ID,"Yantai haofeng trade co., ltd.",YANTAI HAOFENG TRADE CO,CN,China,False,CN,Bei da jie 53hao 1609shi; Zhi fu qu,Yantai,264000,East China|Shandong,+86 18354522200,18354522200@163.com,37.511873,121.396883,Community,['91370602073035263P'],['370602200112047'],['073035263'],,/media/hedwig/iforce/data/BvD/s3-transfer/SuperTable_v3_json/dmc/part-00020-7b09c546-2adc-413e-9e68-18b300e205cf-c000.json,37.511873,121.396883

The output .csv shows that it is incrementally printing the output as each line comes in. In other words, the second time you write to csv, it also prints the first with it. 第三次,它也打印第一個和第二個(等等)。 這是因為您的腳本分別加載每一行(這很好),但每次都編寫整個 dataframe df 相反,您可以嘗試先將所有內容加載到 dataframe 中,然后只寫入.csv一次。 例如,

import pandas as pd
import json
all_data = []
with open('G:\\1.json',encoding='utf-8') as f_json:
    for line in f_json:
        line = line.strip()
        if line:
            all_data.append(json.loads(line))

# now we have all the data in 'all_data'
# only write once
df = pd.json_normalize(all_data)
df.to_csv('G:\\1.csv', index=None,encoding='utf-8', mode='a')

或者,您可以使用 Python 內置的csv模塊,另請參閱如何將 JSON 轉換為 CSV?

暫無
暫無

聲明:本站的技術帖子網頁,遵循CC BY-SA 4.0協議,如果您需要轉載,請注明本站網址或者原文地址。任何問題請咨詢:yoyou2525@163.com.

 
粵ICP備18138465號  © 2020-2024 STACKOOM.COM