read_csv如何在python中精确地工作？

Question

I want to read from a csv file using python. I am working on memory management, so I would like to ask: When I call read_csv of pandas module in python, the data from the file are loaded to the RAM memory and then read, or are they read straight from the disk? If I want to read the csv file in chunks will the data be loaded chunk by chunk in RAM ?

Answer 1

See the documentation :

Also supports optionally iterating or breaking of the file into chunks.

and

chunksize : int, optional

Return TextFileReader object for iteration. See the IO Tools docs for more information on iterator and chunksize.