[英]SQLite in write very slow
I've study sqlite and just wanted to ask: speed record in the file of a prime number in a simple database from one column is 4 seconds. 我研究过sqlite,只想问一个问题:在一个简单的数据库中,从一列开始的质数文件中的速度记录是4秒。 is it ok or i have some software/hardware problems?
可以还是我有一些软件/硬件问题? 256 notes writing above 4 seconds in SQLite and (2ms for not-mysql file writing ) I just can't believe that sqlite is so slow in write.
在SQLite中4秒以上写入256个注释,(非MySQL文件写入2ms)我简直不敢相信sqlite的写入速度如此之慢。
my code for comparison sqlite db work and file db work: 我的比较sqlite数据库工作和文件数据库工作的代码:
package demo_SQLite;
import java.io.BufferedOutputStream;
import java.io.DataOutputStream;
import java.io.File;
import java.io.FileOutputStream;
import java.io.IOException;
import java.sql.Connection;
import java.sql.DriverManager;
import java.sql.PreparedStatement;
import java.sql.Statement;
import java.text.SimpleDateFormat;
import java.util.Date;
import java.util.Random;
import java.util.logging.Level;
import java.util.logging.Logger;
public class demo_SQLite {
private static Connection conn;
private static Statement state;
private static File db = new File("datafile");
public static void main(String[] args) throws IOException {
Debug("Start DB!");
run();
}
private static void run() throws IOException {
try {
if (!db.exists()) {
db.createNewFile();
}
Class.forName("org.sqlite.JDBC");
conn = DriverManager.getConnection("jdbc:sqlite:" + db);
state = conn.createStatement();
state.executeUpdate("create table if not exists a(id integer,"
+ "time INT,"
+ "primary key (id));");
PreparedStatement prep = conn.prepareStatement("insert into a values(?,?)");
for (int i = 0; i < 257; i++) {
int l = new Random().nextInt();
prep.setInt(2, l);
prep.execute();
}
prep.close();
state.close();
Debug("Done! (256)");
file();
} catch (Exception ex) {
Logger.getLogger(Demo_MySQL.class.getName()).log(Level.SEVERE, null, ex);
}
}
private static void file() {
try {
Debug("Start File!");
File file = new File("filebase");
DataOutputStream dos = null;
dos = new DataOutputStream
(new BufferedOutputStream(new FileOutputStream(file)));
int r = 0;
for (int i = 0; i < 257; ++i) {
r = new Random().nextInt();
dos.writeInt(r);
}
dos.flush();
dos.close();
Debug("Done! (256)");
} catch (IOException ex) {
Logger.getLogger(Demo_MySQL.class.getName()).log(Level.SEVERE, null, ex);
}
}
public static void Debug(String msg) {
SimpleDateFormat sdf = new SimpleDateFormat("HH:mm:ss.SSS");
Date date = new Date();
System.out.println("[" + sdf.format(date) + "][DEBUG]: " + msg);
}
}
result: 结果:
run:
[07:53:49.829][DEBUG]: Start DB!
[07:53:53.223][DEBUG]: Done! (256)
[07:53:53.223][DEBUG]: Start File!
[07:53:53.253][DEBUG]: Done! (256)
BUILD SUCCESSFUL (total time: 5 seconds)
4 seconds! 4秒! wow!
哇! it's awesome!
这很棒! please just tell me - this is normal or i do wrong something?
请告诉我-这是正常现象,还是我做错了什么?
UPDATED. 更新。
seems, problem with auto commit. 似乎,自动提交有问题。 as i read somewhere just now, "By default, each INSERT statement is its own transaction. But if you surround multiple INSERT statements with BEGIN...COMMIT then all the inserts are grouped into a single transaction. The time needed to commit the transaction is amortized over all the enclosed insert statements and so the time per insert statement is greatly reduced."
正如我刚才在某个地方看到的那样,“默认情况下,每个INSERT语句都是它自己的事务。但是,如果用BEGIN ... COMMIT包围多个INSERT语句,则所有插入都被分组为一个事务。提交事务所需的时间在所有封闭的插入语句中摊销,因此每个插入语句的时间大大减少了。”
i've just disable auto commit - corrected code and new result: 我只是禁用自动提交-更正的代码和新结果:
package demo_sqlite;
import java.io.BufferedOutputStream;
import java.io.DataOutputStream;
import java.io.File;
import java.io.FileOutputStream;
import java.io.IOException;
import java.sql.Connection;
import java.sql.DriverManager;
import java.sql.PreparedStatement;
import java.sql.ResultSet;
import java.sql.Statement;
import java.text.SimpleDateFormat;
import java.util.Date;
import java.util.LinkedList;
import java.util.List;
import java.util.Random;
public class demo_SQLite {
private static Connection conn;
private static Statement state;
private static File db = new File("datafile");
public static void main(String[] args) throws IOException {
Debug("Start DB!");
run();
}
private static void run() throws IOException {
try {
if (!db.exists()) {
db.createNewFile();
}
//run db driver
Class.forName("org.sqlite.JDBC");
conn = DriverManager.getConnection("jdbc:sqlite:" + db);
state = conn.createStatement();
//check table
state.executeUpdate("create table if not exists a(id integer,"
+ "time INT,"
+ "primary key (id));");
conn.setAutoCommit(false);
// clear table if table not clear
state.execute("DELETE FROM a");
conn.commit();
//make needed notes for db
PreparedStatement prep = conn.prepareStatement("insert into a values(?,?)");
for (int i = 0; i < 256; ++i) {
int l = new Random().nextInt();
prep.setInt(2, l);
prep.execute();
}
conn.commit();
prep.close();
//reading notes for chek
List<Integer> notes = new LinkedList<Integer>();
ResultSet res = state.executeQuery("select * from a");
while (res.next()) { int n = res.getInt("time"); notes.add(n); }
res.close();
state.close();
Debug("Done! ("+ notes.size() + ")");
//write to a file for comparing the write speed
Debug("Start File!");
File file = new File("filebase");
DataOutputStream dos = null;
dos = new DataOutputStream
(new BufferedOutputStream(new FileOutputStream(file)));
int r = 0;
for (int i = 0; i < 256; ++i) {
r = new Random().nextInt();
dos.writeInt(r);
}
dos.flush();
dos.close();
Debug("Done! (256)");
//done! see log for result
} catch (Exception ex) { }
}
public static void Debug(String msg) {
SimpleDateFormat sdf = new SimpleDateFormat("HH:mm:ss.SSS");
Date date = new Date();
System.out.println("[" + sdf.format(date) + "][DEBUG]: " + msg);
}
}
result: 结果:
run:
[09:01:36.890][DEBUG]: Start DB!
[09:01:37.052][DEBUG]: Done! (256)
[09:01:37.053][DEBUG]: Start File!
[09:01:37.054][DEBUG]: Done! (256)
BUILD SUCCESSFUL (total time: 0 seconds)
thanks for all for a answers! 感谢大家的回答! but if you have some considerations about this, please, welcome
但是如果您对此有一些考虑,请欢迎
I might try a different driver. 我可能会尝试其他驱动程序。 Try the one that comes with mySQL : http://www.mysql.com/products/connector/
尝试使用mySQL随附的一种: http : //www.mysql.com/products/connector/
The name of the class that implements java.sql.Driver in MySQL Connector/J is com.mysql.jdbc.Driver.
在MySQL Connector / J中实现java.sql.Driver的类的名称为com.mysql.jdbc.Driver。
声明:本站的技术帖子网页,遵循CC BY-SA 4.0协议,如果您需要转载,请注明本站网址或者原文地址。任何问题请咨询:yoyou2525@163.com.