[英]How to import a large csv into a mysql with java using prepared statements and batch
[英]import csv to mysql with java
所以我有一个csv文件,并想将其导入到mysql,到目前为止,在phpmyadmin中,我可以使用以下行将其导入:
LOAD DATA INFILE 'C:\\Users\\Angel Silva\\Documents\\test.csv' INTO TABLE registros FIELDS ENCLOSED BY '"' TERMINATED BY ',' ESCAPED BY '"' LINES TERMINATED BY '\n'
我的java程序是:
public class recover {
public static void main(String[] args){
try {
String filename ="C:\\Users\\Angel Silva\\Documents\\test.csv";
String query=null;
Class.forName("com.mysql.jdbc.Driver").newInstance();
Connection conn = DriverManager.getConnection("jdbc:mysql://localhost:3306/gg", "root", "");
Statement stmt = conn.createStatement();
query = "LOAD DATA INFILE 'C:\\Users\\Angel Silva\\Documents\\test.csv' INTO TABLE registros FIELDS ENCLOSED BY '\"' TERMINATED BY ',' ESCAPED BY '\"' LINES TERMINATED BY '\\n'";
stmt.executeQuery(query);
ResultSet rs = stmt.executeQuery(query);
} catch (ClassNotFoundException ex) {
Logger.getLogger(recover.class.getName()).log(Level.SEVERE, null, ex);
} catch (InstantiationException ex) {
Logger.getLogger(recover.class.getName()).log(Level.SEVERE, null, ex);
} catch (IllegalAccessException ex) {
Logger.getLogger(recover.class.getName()).log(Level.SEVERE, null, ex);
} catch (SQLException ex) {
Logger.getLogger(recover.class.getName()).log(Level.SEVERE, null, ex);
}
}
}
我收到以下错误:
ene 24, 2016 1:28:33 PM recover main
SEVERE: null
java.sql.SQLException: Row 1 was truncated; it contained more data tha there were input columns
at com.mysql.jdbc.SQLError.createSQLException(SQLError.java:946)
at com.mysql.jdbc.MysqlIO.checkErrorPacket(MysqlIO.java:2985)
at com.mysql.jdbc.MysqlIO.sendCommand(MysqlIO.java:1631)
at com.mysql.jdbc.MysqlIO.sqlQueryDirect(MysqlIO.java:1723)
at com.mysql.jdbc.Connection.execSQL(Connection.java:3277)
at com.mysql.jdbc.Connection.execSQL(Connection.java:3206)
at com.mysql.jdbc.Statement.executeQuery(Statement.java:1232)
at recover.main(recover.java:29)
正如我已经说过的,如果我将查询语句直接输入到phpymyadmin中,我可以恢复表,但是在Java中不起作用
知道我在做什么错吗?
LINES TERMINATED BY '\\r\\n'
(因为它是Windows)
所以最后在阅读mysql doc之后,我将代码修改为:
query="LOAD DATA INFILE 'C:\\\\Users\\\\Angel Silva\\\\Documents\\\\251.csv' INTO TABLE test FIELDS TERMINATED BY ',' ENCLOSED BY '\"' LINES TERMINATED BY '\\r\\n' ";
您必须尝试通过将表列名称附加到查询字符串
" LOAD DATA INFILE 'C:\\Users\\Angel Silva\\Documents\\251.csv' INTO TABLE test FIELDS TERMINATED BY ',' ENCLOSED BY '\"' LINES TERMINATED BY '\\n' (col1,col2,col3) ";
就我而言,它解决了问题...
声明:本站的技术帖子网页,遵循CC BY-SA 4.0协议,如果您需要转载,请注明本站网址或者原文地址。任何问题请咨询:yoyou2525@163.com.