C# - Avoid reading csv file everytime

Question

My input file have 7 million rows. It is taking long time to read the file. After that I have to modify the data based on clients requirement. If client add a new requirement then I have to read the csv file again. Is there any way to read and store csv file in some format in c#. So I can avoid reading csv file everytime. I cannot use SQL ,SQLITE or any other database to store the data.

Answer 1

Your choices are:

1. Use another form of database - eg SQL, Mongo DB, Raven DB, Lucene
2. Store the file in memory, and only save the changes at a certain time
3. Break the file into smaller files, eg ID's 0-100000, 100001-200000, etc
4. Maintain another file of the 'changes' and recombine them as needed (this is probably a bad idea)