繁体   English   中英

将大量数据从一个表插入到另一个 MySQL Python

[英]Insert bulk of data from one table to another MySQL Python

初学者在这里提问。 我希望直接从我在同一会话中运行的查询中填充多行数据的表。 我希望使用 excutemany() 来做到这一点。 目前,我将每一行作为一个元组插入,如下面的脚本所示。

选择查询以获取所需数据:
此查询返回包含 4 列 Parking_ID、Snapshot_Date、Snapshot_Time、Parking_Stat 的数据

    park_set_stat_query    = "SET @row_number = 0;"
    park_set_stat_query2   = "SET @row_number2 = 0;"

   # one time load to catch only the changes done in the input table
    park_change_stat_query =   """select in1.Parking_ID,                                        
                                         in1.Snapshot_Date as Snapshot_Date, 
                                         in1.Snapshot_Time as Snapshot_Time,                                          
                                         in1.Parking_Stat
                                  from (SELECT 
                                         Parking_ID, 
                                         Snapshot_Date, 
                                         Snapshot_Time, 
                                         Parking_Stat, 
                                         (@row_number:=@row_number + 1) AS num1
                                  from Fact_Parking_Stat_Input
                                  WHERE Parking_Stat<>0) as in1                             

                                  left join (SELECT 
                                         Parking_ID, 
                                         Snapshot_Date, 
                                         Snapshot_Time, 
                                         Parking_Stat, 
                                         (@row_number2:=@row_number2 + 1)+1 AS num2
                                  from Fact_Parking_Stat_Input
                                  WHERE Parking_Stat<>0) as in2

                                  on in1.Parking_ID=in2.Parking_ID and in1.num1=in2.num2
                                  WHERE (CASE WHEN in1.Parking_Stat<>in2.Parking_Stat THEN 1 ELSE 0 END=1) OR num1=1"""  

这是脚本的插入部分:
如下所示,我将每一行插入到目标表 Fact_Parking_Stat_Input_Alter

    mycursor = connection.cursor()
    mycursor2 = connection.cursor()

    mycursor.execute(park_set_stat_query)
    mycursor.execute(park_set_stat_query2)
    mycursor.execute(park_change_stat_query) 

#     # keep only changes in a staging table named Fact_Parking_Stat_Input_Alter
    qSQLresults = mycursor.fetchall()
    for row in qSQLresults:
        Parking_ID = row[0]
        Snapshot_Date = row[1] 
        Snapshot_Time = row[2] 
        Parking_Stat = row[3]

        #SQL query to INSERT a record into the table Fact_Parking_Stat_Input_Alter.
        mycursor2.execute('''INSERT into Fact_Parking_Stat_Input_Alter (Parking_ID, Snapshot_Date, Snapshot_Time, Parking_Stat)
                      values (%s, %s, %s, %s)''',
                      (Parking_ID, Snapshot_Date, Snapshot_Time, Parking_Stat))

        # Commit your changes in the database
        connection.commit()

    mycursor.close()
    mycursor2.close()
    connection.close()

如何改进代码以便在插入命令中插入数据?

谢谢阿米尔

MYSQL 有一个 INSERT INTO 命令,它可能比在 python 中查询更有效,拉它并重新插入

https://www.mysqltutorial.org/mysql-insert-into-select/

暂无
暂无

声明:本站的技术帖子网页,遵循CC BY-SA 4.0协议,如果您需要转载,请注明本站网址或者原文地址。任何问题请咨询:yoyou2525@163.com.

 
粤ICP备18138465号  © 2020-2024 STACKOOM.COM