[英]How to read large text files faster in Java?
我只是做了一個簡單的順序中值濾波算法,碰巧使用了2個掃描儀來處理命令行輸入,並使用一個掃描儀來讀取文件。 現在的問題是,我有一個2,000,000
行2列文本的文本文件,格式為<integer> <float>
,要讀取該文件要花費很長時間(超過2分鍾)。
基本上,程序只是獲取輸入,使用中值過濾器算法,然后寫入輸出文件。
下面是我的代碼: main.java
import java.io.BufferedReader;
import java.io.File;
import java.io.FileReader;
import java.io.IOException;
import java.util.ArrayList;
import java.util.List;
import java.util.Scanner;
public class main {
public static void main(String args[]) throws NumberFormatException, IOException{
String inFile; //Input file name.
int filterSize; //Filter size (odd integer >= 3).
String outFile; //Output file name.
int arraySize;
List<Float> elements = new ArrayList<Float>();
int index = 0;
//Scanner to take input file name, filter size and output file name.
Scanner keyboardInput = new Scanner(System.in);
System.out.println("Enter your keyboard input as follows: <data file name> <filter size(odd int >= 3> <output file name>");
//Assigning values to variables.
inFile = keyboardInput.next();
filterSize = keyboardInput.nextInt();
outFile = keyboardInput.next();
// //Reading file
// Scanner readFile = new Scanner(new File(inFile));
// readFile.nextInt(); //Get Array Size
//
// //Add elements into ArrayList
// while(readFile.hasNext()){
// readFile.nextInt();
// elements.add(Float.parseFloat(readFile.next()));
// }
//Reading file
BufferedReader br = new BufferedReader(new FileReader(inFile));
br.readLine(); //Get Array Size
String line;
while((line = br.readLine())!= null){
String[] nums = line.split(" ");
int val = Integer.valueOf(nums[0]);
elements.add(Float.valueOf(nums[1]));
}
br.close();
new Serial(elements, filterSize, outFile);
}
}
串口
import java.io.FileNotFoundException;
import java.io.PrintWriter;
import java.io.UnsupportedEncodingException;
import java.util.ArrayList;
import java.util.Arrays;
import java.util.Collections;
import java.util.List;
public class Serial {
int filterSize; //Filter size (odd integer >= 3).
String outFile; //Output file name.
int arraySize;
List<Float> elements = new ArrayList<Float>();
int index = 0;
public Serial(List<Float> elements, int filterSize, String outFile) throws FileNotFoundException, UnsupportedEncodingException {
this.elements = elements;
this.filterSize= filterSize;
this.outFile = outFile;
List<Float> tempElements = new ArrayList<Float>();
List<Float> outputElements = new ArrayList<Float>();
//Add first boundary element to ouput ArrayList
outputElements.add(this.elements.get(0));
while(elements.size() >= filterSize){
for(int i = 0; i<filterSize; i++){
tempElements.add(this.elements.get(i));
}
Collections.sort(tempElements);
outputElements.add(tempElements.get((filterSize-1)/2));
elements.remove(0);
tempElements.clear();
}
//Add last boundary element to output ArrayList
if (elements != null && !elements.isEmpty()) {
outputElements.add(elements.get(elements.size()-1));
}
/*Trace. Checking if output is correct
for(int i=0; i<outputElements.size(); i++){
System.out.println(outputElements.get(i));
}*/
//Write elements to output file
PrintWriter writeOutput = new PrintWriter(this.outFile, "UTF-8");
writeOutput.println(outputElements.size());//Number of lines
for(int i=0; i<outputElements.size();i++){
writeOutput.println(i+1 + " " + outputElements.get(i)); //Each line is written
}
writeOutput.close(); //Close when output finished writing.
}
}
有沒有辦法更快地讀取文件(以秒為單位)?
謝謝
編輯:示例輸入
5
1 2
2 80
3 6
4 3
5 1
使用Buffered Reader應該會提高讀取文件的速度,因為它的緩沖區大小比Scanner大得多。
我從您以前的一個問題中看到,您最初使用的是Buffered Reader。 您可以逐行閱讀並在空格上拆分字符串,如下所示:
//Reading file
BufferedReader br = new BufferedReader(new FileReader(inFile));
br.readLine(); //Get Array Size
String line;
while((line = br.readLine())!= null){
String[] nums = line.split(" ");
int val = Integer.valueOf(nums[0]);
elements.add(Float.valueOf(nums[1]));
}
br.close();
聲明:本站的技術帖子網頁,遵循CC BY-SA 4.0協議,如果您需要轉載,請注明本站網址或者原文地址。任何問題請咨詢:yoyou2525@163.com.