StreamReader.ReadLine() starting from the end of the stream

Question

I'm working in C#/.NET and I'm parsing a file to check if one line matches a particular regex. Actually, I want to find the line that matches. 一行。

To get the lines of my file, I'm currently using the System.IO.StreamReader.ReadLine() method but as my files are very huge, I would like to optimize a bit the code and start from the end of the file.

Does anyone know if there is in C#/.NET a similar function to ReadLine() starting from the end of the stream? And if not, what would be, to your mind, the easiest and most optimized way to do the job described above?

Answer 1

Funny you should mention it - yes I have. I wrote a ReverseLineReader a while ago, and put it in MiscUtil .

It was in answer to this question on Stack Overflow - the answer contains the code, although it uses other bits of MiscUtil too.

It will only cope with some encodings, but hopefully all the ones you need. Note that this will be less efficient than reading from the start of the file, if you ever have to read the whole file - all kinds of things may assume a forward motion through the file, so they're optimised for that. But if you're actually just reading lines near the end of the file, this could be a big win :)

(Not sure whether this should have just been a close vote or not...)

Answer 2

Since you are using a regular expression I think your best option is going to be to read the entire line into memory and then attempt to match it.

Perhaps if you provide us with the regular expression and a sample of the file contents we could find a better way to solve your problem.

Answer 3

"Easiest" -vs- "Most optimized"... I don't think you're going to get both

You could open the file and read each line. Each time you find one that fits your criteria, store it in a variable (replacing any earlier instance). When you finish, you will have the last line that matches.

You could also use a FileStream to set the position near the end of your file. Go through the steps above, and if no match is found, set your FileStream position earlier in your file, until you DO find a match.

Answer 4

This ought to do what you're looking for, it might be memory heavy for what you need, but I don't know what your needs are in that area:

        string[] lines = File.ReadAllLines("C:\\somefilehere.txt");
        IEnumerable<string> revLines = lines.Reverse();
        foreach(string line in revLines) {
            /*do whatever*/
        }

It would still require reading every line at the outset, but it might be faster than doing a check on each one as you do so.