如何使用bash脚本修改多个文件

Question

I have a file called script.sh with the following code:

#!/bin/bash

file=list.txt
IFS=$','
cat $file 
for i in `cat $file`
do
    echo "The name of the file I am going edit is $i"
    awk 'BEGIN{FS=OFS=","} /^\<AA_xx\>/||/^\<AA\>/{$160="CC,0,DD,0"} 1' $i \
        > temp_file.csv && mv temp_file.csv $i
done

list.txt contains the path to a .csv file, eg, /ws/user/stack.csv .

However, I would like to modify this script to read all the files I specify in list.txt , ie, my list.txt contains

/ws/user/stack.csv
/ws/user/stack1.csv
/ws/user/stack2.csv

I want the script to use this awk in each file mentioned in list.txt .

Can you help me with this?

Answer 1

The following does the trick

script.sh

#!/bin/bash
while read -r line; do
    cat "$line" | awk '{print $0}' > "output_$line"
done < "$1"

Then you just call it with

$ ./script.sh list.txt

If you have a large awk code, I recommend organizing it in a function.

script.sh

#!/bin/bash
yourAwkFunction(){
    awk '{print $0}'
}

while read -r line; do
    cat "$line" | yourAwkFunction > "output_$line"
done < "$1"

line is the variable that receives the value of each line of list.txt . This means that line is /ws/user/stack.csv for the first iteration and then /ws/user/stack.csv1 for the second and so on.

For more on reading lines of files, you may check http://mywiki.wooledge.org/BashFAQ/001

Answer 2

Since your comment says list.txt is newline separated, just follow how to read a file line by line here: Read a file line by line assigning the value to a variable

Which would give you:

#!/bin/bash

while IFS='' read -r file || [[ -n "$file" ]]; do
  echo "The name of the file I am going edit is $file"
  awk 'BEGIN{FS=OFS=","} /^\<AA_xx\>/||/^\<AA\>/{$160="CC,0,DD,0"} 1' $file \
    > temp_file.csv && mv temp_file.csv $file
done < list.txt