使用ParallelForeach处理文件。 这是最好的方法吗？

Question

Just some advice I have 100.000+ xml file to process and move to another system.

The concept is pretty simple I have a loop like:

    public void ProcessFiles()
    {
        IEnumerable<FileInfo> orderedFiles = GetFilesOrdered();

        foreach (FileInfo file in orderedFiles)
        {
            ProcessFile(file);
        }
    }

I have been reading about Task Parallel library but not that confident. Not that very glued up on threading. It seems that TPL wraps lots for me.

To put it simply is it just a case of using parallel.Foreach?

any sample or suggestions

Answer 1

Yes, it might be as simple as replacing foreach with Parallel.ForEach .

You have to remember that multiple threads would now be executing ProcessFile concurrently.

So, if you are writing to any shared state in that method, you will have to use synchronization constructs to protect it.

If you're new to multi-threading, there's a great introductory ebook you should read here: Albahari

Answer 2

Hope it is helpful to you. Simple snippet to demo how to move the file in parallel.

        List<FileInfo> files = new List<FileInfo>();
        files.Add(new FileInfo("F:\\1.xml"));
        files.Add(new FileInfo("F:\\2.xml"));
        files.Add(new FileInfo("F:\\3.xml"));



        Parallel.ForEach(files, f =>
        {
            f.MoveTo("d:\\test\\" + f.Name); 
        });