How to compress a processed text file in Python?

Question

I have a text file which I constantly append data to. When processing is done I need to gzip the file. I tried several options like shutil.make_archive , tarfile , gzip but could not eventually do it. Is there no simple way to compress a file without actually writing to it?

Let's say I have mydata.txt file and I want it to be gzipped and saved as mydata.txt.gz .

Answer 1

I don't see the problem. You should be able to use eg the gzip module just fine, something like this:

inf = open("mydata.txt", "rb")
outf = gzip.open("file.txt.gz", "wb")
outf.write(inf.read())
outf.close()
inf.close()

There's no problem with the file being overwritten, the name given to gzip.open() is completely independent of the name given to plain open() .

Answer 2

如果要压缩文件而不写入文件，则可以使用Python库subprocess os.system或popen或os.system运行shell命令，例如gzip 。