根据部分文件名合并文件

Question

I have about 450 csv files in a folder with names in the format (sample names below):

1_a.csv

1_b.csv

1_c.csv

...

1_h.csv

2_a.csv

2_b.csv

...

2_h.csv

...

42_a.csv

...

42_h.csv

I wish to combine all files of the type "1_xxx.csv" into "1.csv", all files of the format "2_xxx.csv" into "2.csv" and so on.

I tried using cat but I am only able to merge one set of files at a time. Is there a way to run the command in loop in linux? Any Python3 based solutions are also welcome.

Answer 1

For a python solution the comment provided by mnistic links to a solution. If you want a bash solution you can use the find command with the -exec flag like

find . -name "1_*.csv" -exec cat {} >> 1.csv \;

That command should find all the csv files beginning with 1_ and then appending them to the file 1.csv.

For more information on find check out https://ss64.com/bash/find.html

EDIT: For a loop

for i {1..450}
do
    find . -name "$i_*.csv" -exec cat {} >> $i.csv \;
done

this should work

Source: http://go2linux.garron.me/bash-for-loop/