如何处理R中的数百个文件？

Question

I want to parse last year weather data which are recorded in CSV files. Each CSV file includes one day of data. So I have 365 CSV files need to parse. What is the best way to handle these files? As far as I know, I need to load all of them into R and bind them into one big data frame. But I don't know whether this is the best solution. What if I have more than one years of data files? Do I need to load all of them into memory? Or is there any other way to handle them?

Each file is about 1M to 1.5M.

Answer 1

The easiest way to do this is to get all your files to read using list.files , read them into a list of data frames, then rbind all the frames together:

#setwd('dirwithallmycsvs')

x <- list.files(pattern = '.+\\.csv$')

out = lapply(x, read.csv)

out2 = do.call(rbind, out)

Your output should now be one dataframe. You will need to take care all the columns are the same across your files.