在Java中读取GZIP文件导致ZLIB输入流意外结束

Question

I am converting GZIP byte array to String form in Java.This is considerably large file and idea is to convert this in to JSON.

But Exception I am getting is quite weird and is not making much Sense.

Code Snippeet:

public static String convert(byte[] bytes) throws IOException {
        final byte[] BUFFER = new byte[16234];

        GZIPInputStream gzipInputStream = new GZIPInputStream(new ByteArrayInputStream(bytes));

        ByteArrayOutputStream byteArrayOutputStream = new ByteArrayOutputStream();

        int len;
        while ((len = gzipInputStream.read(BUFFER)) >= 0) {
            byteArrayOutputStream.write(BUFFER, 0, len);
          if(byteArrayOutputStream.size ()>60812918){
                System.out.println ( "stopping here" );
            }
        }

        byteArrayOutputStream.flush();
        byteArrayOutputStream.close();

        gzipInputStream.close();

        final byte[] dataPart = byteArrayOutputStream.toByteArray();

        String data = new String(dataPart, StandardCharsets.UTF_8);

        return data;
    }

Exception Trace:

java.io.EOFException: Unexpected end of ZLIB input stream
    at java.util.zip.InflaterInputStream.fill(InflaterInputStream.java:240)
    at java.util.zip.InflaterInputStream.read(InflaterInputStream.java:158)
    at java.util.zip.GZIPInputStream.read(GZIPInputStream.java:117)
    at java.io.FilterInputStream.read(FilterInputStream.java:107)
    at com.here.rcs.discoverkernels.testS3FileReader.convert(testS3FileReader.java:84)
    at com.here.rcs.discoverkernels.testS3FileReader.viewJson(testS3FileReader.java:45)
    at com.here.rcs.discoverkernels.testS3FileReader.main(testS3FileReader.java:21)

From Coding point of view,I don't think there is something wrong with this piece of code.

Any Suggestions how to move forward with this.

Adding To Byte Conversion Part;

public static byte[] compress(final String data) throws IOException {

    final byte[] dataPart = data.getBytes( StandardCharsets.UTF_8 );

    ByteArrayOutputStream byteArrayOutputStream = new ByteArrayOutputStream();

    GZIPOutputStream gzipOutputStream = new GZIPOutputStream(byteArrayOutputStream);
    gzipOutputStream.write(dataPart);

    gzipOutputStream.flush();
    gzipOutputStream.close();

    byte[] bytes = byteArrayOutputStream.toByteArray();

    return bytes;
}

Answer 1

I tried your program with a small .gz file, and it works as expected. I guess that

1. there are issues handling large files, or, more likely,
2. you did not loaded correctly data from file to bytes array. How did you? I followed this article: https://netjs.blogspot.com/2015/11/how-to-convert-file-to-byte-array-java.html