使用Python自动执行文件读取和功能应用

Question

How can I automate 'csv' file reading, wherein I have to read files after every five minutes and apply some operations using Pandas. I don't want to manually read every file and name each one of it and then apply the functions (self defined) on those files. I'm a beginner in Programming. These are the functions I want to apply after reading the file. Thanks in advance!

df_9May = PreprocessDataframe(df_9May) #calling the function for the 9th May DF 



'''Reading the new DataFrame''' 

df_10May = pd.read_csv('fo10MAY2018bhav.csv', parse_dates = True)
df_10May = PreprocessDataframe(df_10May)


df_9_10 = combineDFs(df_9May, df_10May)
#print("count = {}".format(count))

df_9_10 = NewNetVal_AvgPrice(df_9_10)



df_11May = pd.read_csv('fo11MAY2018bhav.csv')
df_11May = PreprocessDataframe(df_11May)


df_10_11 = combineDFs(df_9_10, df_11May)

Answer 1

Use the time module to sleep and perform your tasks at regular intervals (5 minutes in this case) Provide the folder/directory path and using the os.listdir(path) you can get the list of your file names.

import time, os
path = input("CSV Files directory path")
flist = [file for file in os.listdir(path) if file.endswith('.csv')]

while True:  # Runs indefinitely or you could assign a counter n-times
  for file in flist:
    # Read the CSV File using pandas
    # perform your custom operations
  time.sleep(300) # 300 Seconds