在 tar.z 文件中读取为 python 3.7.4 中的 pandas 数据帧？

Question

I want to download a dataset from the UCI repository.

The dataset is in the tar.Z format, and ideally I'd like to read it in as a pandas data frame.

I've checked out uncompressing tar.Z file with python? which suggested the zgip library, so from https://docs.python.org/3/library/gzip.html I tried using the below code but I got an error message.

Thanks for any help!

import gzip
with gzip.open('https://archive.ics.uci.edu/ml/machine-learning-databases/diabetes/diabetes-data.tar.Z', 'rb') as f:
file_content = f.read()  

ERROR MESSAGE:
OSError: [Errno 22] Invalid argument: 'https://archive.ics.uci.edu/ml/machine-learning-databases/diabetes/diabetes-data.tar.Z'

Answer 1

I do not think that you can read the .Z data with any module in Python; you could browse Pypi, and see if there is a module for the .Z extension. You could however, use the command line to process the data.

import subprocess
from io import StringIO

data = subprocess.run(
    """curl https://archive.ics.uci.edu/ml/machine-learning-databases/diabetes/diabetes-data.tar.Z | 
    tar -xOvf diabetes-data.tar.Z --wildcards 'Diabetes-Data/data-*' """,
    shell=True,
    capture_output=True,
    text=True,
).stdout


df = pd.read_csv(StringIO(data), sep="\t", header=None)

df.head()

        0       1        2  3
0   04-21-1991  9:09    58  100
1   04-21-1991  9:09    33  009
2   04-21-1991  9:09    34  013
3   04-21-1991  17:08   62  119
4   04-21-1991  17:08   33  007

You can read this ebook for more on command line options.