堆栈内存溢出
  繁体   English   中英

使用 java 中的 Apache POI 读取 xls 或 xlsx 文件会给出 java.lang.OutOfMemoryError: GC 开销限制超出

[英]Reading xls or xlsx file using Apache POI in java gives java.lang.OutOfMemoryError: GC overhead limit exceeded

 原文  2022-09-23 05:21:26  2   0    excel/ java-8/ apache-poi

问题描述

我正在尝试从 excel 文件中读取数据。 excel文件没有任何宏，它只是一个普通的excel文件。文件大小约为7mb，文件有5张。 我必须阅读每张纸并将数据插入数据库。 我的要求是读取 excel 文件，不要写回同一个 excel 文件或修改 excel 文件。 我尝试了不同的读取文件的方法，但得到了 java.lang.OutOfMemoryError: GC overhead limit exceeded 。 并且此代码在 tomcat 服务器中执行，而不是独立应用程序

我的java版本是8

Apache-Poi 版本为 3.14

Apache tomcat版本为9

tomcat 中的堆空间为 -Xmx1024m

注意：我没有增加堆空间的选项

以下是我尝试过的代码

我正在阅读整个文件一次并创建一个工作簿并将此工作簿传递给不同的方法以读取每种方法所需的工作表。

public Workbook getWorkBook (String path, String fileName) {
    log.info(dateFormat.format(new java.util.Date()) + " -- start getWorkBook");
    String reportTypeExcelPath = path + fileName;;
    try {
        File file = new File(reportTypeExcelPath);
        if (file.exists()) {
            OPCPackage pkg;
            try {
                //excelFile = new BufferedInputStream(new FileInputStream(file));
                pkg = OPCPackage.open(file.getAbsolutePath());
                log.info("Total Memory " + Runtime.getRuntime().totalMemory());
                log.info("Free Memory " + Runtime.getRuntime().freeMemory());
                Instant start = java.time.Instant.now();
                workbook =  WorkbookFactory.create(pkg);
                Instant end = java.time.Instant.now();
                Duration between = java.time.Duration.between(start, end);
                log.info("between in checkMandatorySheets " + between );
                pkg.close();
                log.info(dateFormat.format(new java.util.Date()) + " -- end getWorkBook");
                return workbook;
            } catch (InvalidFormatException e) {
                System.out.println("Exception in checkMandatorySheets() :: \n" +  e);
                return null ;
            }
            
        } else {
            System.out.println("No file found " + reportTypeExcelPath);
            return null ;
        }
    } catch (IOException e) {
        System.out.println("Exception in checkMandatorySheets() :: \n" +  e);
        return null ;
    }
}

这就是错误

java.lang.OutOfMemoryError: GC overhead limit exceeded
at org.apache.xmlbeans.impl.store.Cur$CurLoadContext.attr(Cur.java:3039)
at org.apache.xmlbeans.impl.store.Cur$CurLoadContext.attr(Cur.java:3060)
at org.apache.xmlbeans.impl.store.Locale$SaxHandler.startElement(Locale.java:3250)
at org.apache.xmlbeans.impl.piccolo.xml.Piccolo.reportStartTag(Piccolo.java:1082)
at org.apache.xmlbeans.impl.piccolo.xml.PiccoloLexer.parseAttributesNS(PiccoloLexer.java:1802)
at org.apache.xmlbeans.impl.piccolo.xml.PiccoloLexer.parseOpenTagNS(PiccoloLexer.java:1521)
at org.apache.xmlbeans.impl.piccolo.xml.PiccoloLexer.parseTagNS(PiccoloLexer.java:1362)
at org.apache.xmlbeans.impl.piccolo.xml.PiccoloLexer.parseXMLNS(PiccoloLexer.java:1293)
at org.apache.xmlbeans.impl.piccolo.xml.PiccoloLexer.parseXML(PiccoloLexer.java:1261)
at org.apache.xmlbeans.impl.piccolo.xml.PiccoloLexer.yylex(PiccoloLexer.java:4808)
at org.apache.xmlbeans.impl.piccolo.xml.Piccolo.yylex(Piccolo.java:1290)
at org.apache.xmlbeans.impl.piccolo.xml.Piccolo.yyparse(Piccolo.java:1400)
at org.apache.xmlbeans.impl.piccolo.xml.Piccolo.parse(Piccolo.java:714)
at org.apache.xmlbeans.impl.store.Locale$SaxLoader.load(Locale.java:3439)
at org.apache.xmlbeans.impl.store.Locale.parseToXmlObject(Locale.java:1270)
at org.apache.xmlbeans.impl.store.Locale.parseToXmlObject(Locale.java:1257)
at org.apache.xmlbeans.impl.schema.SchemaTypeLoaderBase.parse(SchemaTypeLoaderBase.java:345)
at org.openxmlformats.schemas.spreadsheetml.x2006.main.WorksheetDocument$Factory.parse(Unknown Source)
at org.apache.poi.xssf.usermodel.XSSFSheet.read(XSSFSheet.java:153)
at org.apache.poi.xssf.usermodel.XSSFSheet.onDocumentRead(XSSFSheet.java:145)
at org.apache.poi.xssf.usermodel.XSSFWorkbook.onDocumentRead(XSSFWorkbook.java:201)
at org.apache.poi.POIXMLDocument.load(POIXMLDocument.java:200)
at org.apache.poi.xssf.usermodel.XSSFWorkbook.<init>(XSSFWorkbook.java:151)
at org.apache.poi.ss.usermodel.WorkbookFactory.create(WorkbookFactory.java:45)

我还检查了 memory，这些是结果

总计 Memory 549453824

免费 Memory 116004584

大约是 110.630592346 MB，我的文件大小是 7 MB

在这行代码触发了超出的 GC 开销限制

工作簿 = WorkbookFactory.create(pkg);

以下是尝试读取 excel 文件的不同方法

public static void method1() {
    String reportTypeExcelPath = "D:\\File Testing\\Testing File.xlsx";
    try {
        File file = new File(reportTypeExcelPath);
        if (file.exists()) {
                FileInputStream excelFile = new FileInputStream(reportTypeExcelPath);
                Instant start = java.time.Instant.now();
                XSSFWorkbook workbook = new XSSFWorkbook(excelFile);
                Instant end = java.time.Instant.now();
                Duration between = java.time.Duration.between(start, end);
                System.out.println("Method1");
                System.out.println( between ); // PT1.001S
                System.out.format("%dD, %02d:%02d:%02d.%04d \n", between.toDays(),
                        between.toHours(), between.toMinutes(), between.getSeconds(), between.toMillis());
                
                
        } else {
            System.out.println("No file found " + reportTypeExcelPath);
            return ;
        }
    } catch (IOException e) {
        System.out.println("Exception in checkMandatorySheets() :: \n" +  e);
        return ;
    }
} 

public static void method2() {
    String reportTypeExcelPath = "D:\\File Testing\\Testing File.xlsx";
    try {
        File file = new File(reportTypeExcelPath);
        if (file.exists()) {
            OPCPackage pkg;
            try {
                pkg = OPCPackage.open(file);
                Instant start = java.time.Instant.now();
                XSSFWorkbook workbook = new XSSFWorkbook(pkg);
                Instant end = java.time.Instant.now();
                Duration between = java.time.Duration.between(start, end);
                System.out.println("Method2");
                System.out.println( between ); // PT1.001S
                System.out.format("%dD, %02d:%02d:%02d.%04d \n", between.toDays(),
                        between.toHours(), between.toMinutes(), between.getSeconds(), between.toMillis());
                pkg.close();
            } catch (InvalidFormatException e) {
                System.out.println("Exception in checkMandatorySheets() :: \n" +  e);
                return ;
            }
            
        } else {
            System.out.println("No file found " + reportTypeExcelPath);
            return ;
        }
    } catch (IOException e) {
        System.out.println("Exception in checkMandatorySheets() :: \n" +  e);
        return ;
    }
}

public static void method3() {
    String reportTypeExcelPath = "D:\\File Testing\\Testing File.xlsx";
    try {
        File file = new File(reportTypeExcelPath);
        if (file.exists()) {
            OPCPackage pkg;
            try {
                FileInputStream excelFile = new FileInputStream(reportTypeExcelPath);
                pkg = OPCPackage.open(excelFile);
                Instant start = java.time.Instant.now();
                XSSFWorkbook workbook = new XSSFWorkbook(pkg);
                Instant end = java.time.Instant.now();
                Duration between = java.time.Duration.between(start, end);
                System.out.println("Method3");
                System.out.println( between ); // PT1.001S
                System.out.format("%dD, %02d:%02d:%02d.%04d \n", between.toDays(),
                        between.toHours(), between.toMinutes(), between.getSeconds(), between.toMillis());
                pkg.close();
            } catch (InvalidFormatException e) {
                System.out.println("Exception in checkMandatorySheets() :: \n" +  e);
                return ;
            }
            
        } else {
            System.out.println("No file found " + reportTypeExcelPath);
            return ;
        }
    } catch (IOException e) {
        System.out.println("Exception in checkMandatorySheets() :: \n" +  e);
        return ;
    }
}

public static void method4() {
    String reportTypeExcelPath = "D:\\File Testing\\Testing File.xlsx";
    try {
        File file = new File(reportTypeExcelPath);
        if (file.exists()) {
            OPCPackage pkg;
            try {
                pkg = OPCPackage.open(file);
                Instant start = java.time.Instant.now();
                Workbook wb = WorkbookFactory.create(pkg);
                Instant end = java.time.Instant.now();
                Duration between = java.time.Duration.between(start, end);
                System.out.println("Method4");
                System.out.println( between ); // PT1.001S
                System.out.format("%dD, %02d:%02d:%02d.%04d \n", between.toDays(),
                        between.toHours(), between.toMinutes(), between.getSeconds(), between.toMillis());
                pkg.close();
            } catch (InvalidFormatException e) {
                System.out.println("Exception in checkMandatorySheets() :: \n" +  e);
                return ;
            }
            
        } else {
            System.out.println("No file found " + reportTypeExcelPath);
            return ;
        }
    } catch (IOException e) {
        System.out.println("Exception in checkMandatorySheets() :: \n" +  e);
        return ;
    }
}

public static void method5() {
    String reportTypeExcelPath = "D:\\File Testing\\Testing File.xlsx";
    try {
        File file = new File(reportTypeExcelPath);
        if (file.exists()) {
            OPCPackage pkg;
            try {
                FileInputStream excelFile = new FileInputStream(reportTypeExcelPath);
                pkg = OPCPackage.open(excelFile);
                Instant start = java.time.Instant.now();
                Workbook wb = WorkbookFactory.create(pkg);
                Instant end = java.time.Instant.now();
                Duration between = java.time.Duration.between(start, end);
                System.out.println("Method5");
                System.out.println( between ); // PT1.001S
                System.out.format("%dD, %02d:%02d:%02d.%04d \n", between.toDays(),
                        between.toHours(), between.toMinutes(), between.getSeconds(), between.toMillis());
                pkg.close();
            } catch (InvalidFormatException e) {
                System.out.println("Exception in checkMandatorySheets() :: \n" +  e);
                return ;
            }
            
        } else {
            System.out.println("No file found " + reportTypeExcelPath);
            return ;
        }
    } catch (IOException e) {
        System.out.println("Exception in checkMandatorySheets() :: \n" +  e);
        return ;
    }
}

public static void method6() {
    String reportTypeExcelPath = "D:\\File Testing\\Testing File.xlsx";
    try {
        File file = new File(reportTypeExcelPath);
        if (file.exists()) {
            try {
                FileInputStream excelFile = new FileInputStream(reportTypeExcelPath);
                Instant start = java.time.Instant.now();
                Workbook wb = WorkbookFactory.create(excelFile);
                Instant end = java.time.Instant.now();
                Duration between = java.time.Duration.between(start, end);
                System.out.println("Method6");
                System.out.println( between ); // PT1.001S
                System.out.format("%dD, %02d:%02d:%02d.%04d \n", between.toDays(),
                        between.toHours(), between.toMinutes(), between.getSeconds(), between.toMillis());
            } catch (InvalidFormatException e) {
                System.out.println("Exception in checkMandatorySheets() :: \n" +  e);
                return ;
            }
            
        } else {
            System.out.println("No file found " + reportTypeExcelPath);
            return ;
        }
    } catch (IOException e) {
        System.out.println("Exception in checkMandatorySheets() :: \n" +  e);
        return ;
    }
}

public static void method7() {
    String reportTypeExcelPath = "D:\\File Testing\\Testing File.xlsx";
    try {
        File file = new File(reportTypeExcelPath);
        if (file.exists()) {
            try {
                Instant start = java.time.Instant.now();
                Workbook wb = WorkbookFactory.create(file);
                Instant end = java.time.Instant.now();
                Duration between = java.time.Duration.between(start, end);
                System.out.println("Method7");
                System.out.println( between ); // PT1.001S
                System.out.format("%dD, %02d:%02d:%02d.%04d \n", between.toDays(),
                        between.toHours(), between.toMinutes(), between.getSeconds(), between.toMillis());
            } catch (InvalidFormatException e) {
                System.out.println("Exception in checkMandatorySheets() :: \n" +  e);
                return ;
            }
            
        } else {
            System.out.println("No file found " + reportTypeExcelPath);
            return ;
        }
    } catch (IOException e) {
        System.out.println("Exception in checkMandatorySheets() :: \n" +  e);
        return ;
    }
}

并且GC错误发生在这些点

XSSFWorkbook workbook = new XSSFWorkbook(excelFile);

XSSFWorkbook workbook = new XSSFWorkbook(pkg);

Workbook wb = WorkbookFactory.create(pkg);

Workbook wb = WorkbookFactory.create(file);

我在堆栈溢出中经历了多个链接，但没有任何帮助。

加载文件的任何建议或替代方法。

0 个解决方案

暂无
暂无

声明:本站的技术帖子网页，遵循CC BY-SA 4.0协议，如果您需要转载，请注明本站网址或者原文地址。任何问题请咨询:yoyou2525@163.com.

相关问题 java.lang.OutOfMemoryError：超出GC开销限制，通过Apache POI读取启用宏的Excel工作表时出错 使用Java和Apache poi从.xls或.xlsx文件中读取内容 Apache POI 超出了 GC 开销限制 使用Apache POI从java中读取和写入xls和xlsx excel文件 使用Apache POI将数据写入Java中的xls，xlsx，csv文件 Apache POI WorkFactory.Create(new File()) java.lang.OutOfMemoryError java.lang.OutOfMemoryError：使用XLSReader将Excel文件读入Java bean时的Java堆空间 对XLSX Apache poi使用Java临时文件 java.lang.OutOfMemoryError：使用jxls编写xlsx时的Java堆空间 Java.lang.OutOfMemoryError：Java堆空间org.apache.poi.ss.formula.FormulaCellCacheEntrySet.add（FormulaCellCacheEntrySet.java:63）
相关标签
 
粤ICP备18138465号  © 2020-2024 STACKOOM.COM