在 bash 脚本中重用虚拟文件

Question

What I am trying to do is run a bash script that looks somewhat like this:

#!/usr/bin/bash

only1=$(comm -23 $1 $2 | wc -l)
only2=$(comm -13 $1 $2 | wc -l)
common=$(comm -12 $1 $2 | wc -l)

echo -e "${only1} only in $1"
echo -e "${only2} only in $2"
echo -e "${common} in both"

If I execute the script as script.sh file1 file2 it works fine. However, if I use it as script.sh <(grep 'foo' file1) <(grep 'foo' file2) it fails because the virtual files of the kind dev/fd/62 are only available for the first command ( only1 in the script). The output is:

262 only in /dev/fd/63
0 only in /dev/fd/62
0 in both

Is there a way to make these virtual files available to all of the commands in the script?

Answer 1

The issue here is that the first invocation of comm will read to the end of both input files.

As you'd like to be able to provide pipes as the input (instead of a " real file), you'll need read the inputs once only, and then provide that as input to the subsequent commands... With pipes, as soon as data is read, it's gone and isn't coming back.

For example:

#!/bin/bash -eu

# cleanup temporary files on exit
trap 'rm ${TMP_FILE1:-} ${TMP_FILE2:-}' EXIT

TMP_FILE1=$(mktemp)
cat < $1 > $TMP_FILE1

TMP_FILE2=$(mktemp)
cat < $2 > $TMP_FILE2

only1=$(comm -23 $TMP_FILE1 $TMP_FILE2 | wc -l)
only2=$(comm -13 $TMP_FILE1 $TMP_FILE2 | wc -l)
common=$(comm -12 $TMP_FILE1 $TMP_FILE2 | wc -l)

echo -e "${only1} only in $1"
echo -e "${only2} only in $2"
echo -e "${common} in both"

If your files are small enough, then you can get away with reading them into variables:

#!/bin/bash -eu

FILE1=$( < $1 )
FILE2=$( < $2 )

only1=$(comm -23 <( echo "$FILE1" ) <( echo "$FILE2" ) | wc -l)
only2=$(comm -13 <( echo "$FILE1" ) <( echo "$FILE2" ) | wc -l)
common=$(comm -12 <( echo "$FILE1" ) <( echo "$FILE2" ) | wc -l)

echo -e "${only1} only in $1"
echo -e "${only2} only in $2"
echo -e "${common} in both"

---

Please also note that comm only works on sorted data... which means you probably want to use sort on the inputs, unless you are fully aware of the consequences of using unsorted inputs.

sort < $1 > $TMP_FILE1

FILE1=$( sort < $1 )