使用 Java NIO 读写大文件（>1Gb）合适吗？

Question

i am trying to read and write a large file typically more than 1 Gb files in each transaction to another storage location. what is the most efficient in terms of performance and low memory (preventing any OOM situation) to transfer the file by writing it to another storage location?

i saw Java NIO is a more efficient way as compared to traditional Java IO but is it really suitable in my use case and will it be an overkill?

Answer 1

I have tried copying large files of this size (1GB). The time taken depends more on the underlying hardware and network status than Java NIO itself. As a simple example that I tried just now, copying a file of 989M took the following average timings.

Note: There was not much difference when the file already existed and needed to be replaced.

1. From an SSD folder to an SSD folder: 4ms
2. From an SSD folder to an HDD (5400rpm) folder: ~7ms
3. From an HDD(5400rpm) folder to an SSD folder: 4ms
4. From an HDD(5400rpm)folder to an HDD (5400rpm) folder: ~7ms

I observed the following:

1. That reading is not causing much of a difference.
2. That replacing an existing file with new contents is not causing much difference.
3. That there is a difference in writing based on the hard disk.

When we run tests on network drives, I am sure there will be great variation due to network variables.