使用 pandas to_csv 将结果写入 csv

Question

下面是我的代码，它从 excel 表中获取实例名称，并在 aws 帐户中搜索实例名称并获取实例 ID。 所以这个过程运行良好。 现在我想将数据写入 csv 就像在 csv 中一样，必须有两列名称如 instancename 和 instanceId，并且数据应打印在各自的列中。 请帮助我获得所需的 output。 csv 与数据重叠，一旦打开 csv，我只能看到其中的最后一个值，因为我的脚本会覆盖以前的结果。

import pandas as pd
from pandas import ExcelWriter
from pandas import ExcelFile
import numpy as np
import os
import boto3
client = boto3.client('ec2')
THIS_FOLDER = os.path.dirname(os.path.abspath(__file__))
my_file = os.path.join(THIS_FOLDER, 'example.xlsx')

df = pd.read_excel(my_file, sheet_name='Sheet2')

list1 = df['EC2NAMES']
print(list1)
client = boto3.client('ec2')
for names in list1:
    custom_filter = [{
        'Name':'tag:Name', 
        'Values': [names]}]
    print(names)
    instances = client.describe_instances(Filters=custom_filter)
    for instance in instances['Reservations']:
        for key in instance["Instances"]:
            x = key['InstanceId']
            print(x)
            data = pd.DataFrame({'A' : [names],'B' : [x]})
            data.to_csv('df111111.csv')

预期 output：

Instancename  InstanceID
testinstance  123456
testinstance1 12345656312
testinstance2 12345657237

实际 output：

Instancename  InstanceID
testinstance2 12345657237

Answer 1

You can use pandas concat or append but best way is to store the data into list and in the end make a dataframe of that and save it as csv.

import pandas as pd
from pandas import ExcelWriter
from pandas import ExcelFile
import numpy as np
import os
import boto3
client = boto3.client('ec2')
THIS_FOLDER = os.path.dirname(os.path.abspath(__file__))
my_file = os.path.join(THIS_FOLDER, 'example.xlsx')

df = pd.read_excel(my_file, sheet_name='Sheet2')

list1 = df['EC2NAMES']
print(list1)
client = boto3.client('ec2')
data = []
for names in list1:
    custom_filter = [{
        'Name':'tag:Name', 
        'Values': [names]}]
    print(names)
    instances = client.describe_instances(Filters=custom_filter)
    for instance in instances['Reservations']:
        for key in instance["Instances"]:
            x = key['InstanceId']
            print(x)
            data.append([names, x])
pd.DataFrame(data, colums=['A','B']).to_csv('df111111.csv')

Answer 2

您的代码为 for 循环的每次迭代创建一个新的“数据”变量。 我的尝试是在开始循环之前制作一个空白数据变量。 在每个循环中添加一个新的 dataframe，一旦你退出循环，你将它保存到 csv

data = pd.DataFrame()
list1 = df['EC2NAMES']
print(list1)
client = boto3.client('ec2')
for names in list1:
    custom_filter = [{
        'Name':'tag:Name', 
        'Values': [names]}]
    print(names)
    instances = client.describe_instances(Filters=custom_filter)
    for instance in instances['Reservations']:
        for key in instance["Instances"]:
            x = key['InstanceId']
            print(x)
            data = data.append(pd.DataFrame({'A' : [names],'B' : [x]}))
data.to_csv('df111111.csv')