包含矩阵和向量的动态列表/数组

Question

so I have the following setup. I have a folder with two different file types. One file type (.m) are files of matrices and the other file type are the corresponding vectors (.txt). They have the same name ie matrix1.m and matrix1.txt

I want to create a list or an array such that I can save each matrix and each corresponding vector. I thought about a panda data frame, but I do not know if this is useful here.

Is there a way to do this?

for file1 in os.listdir(path):
    file1name = os.fsdecode(file1)
    if file1.endswith('.m'):
        file2 = file1name.replace('.m', '.txt')
        file2name = os.fsdecode(file2)

        matrix = np.matrix(scipy.io.mmread(os.path.join(path, file1name)).toarray())
        vector = np.loadtxt(os.path.join(path, file2name)
        continue

Answer 1

This is how I would approach something like this given-

I need to do and store some result for each pair of files Each pair is independent The reason the code above isn't enough is because you wanted to try and speed things up.

Don't know if this will help, but it is one approach.

pool = ThreadPool()
op_names = {name.split('.')[0] for name in os.listdir(path)}
def operation(name):
  matrix_filename = f'name.m'
  vector_filename = f'name.txt'
  return name, do_op(matrix_filename, vector_filename)

results = pool.map(operation, op_names)