如何使用awk处理ASCII不可打印字符

Question

First using cat command cat -v -e -t <my_file> I have this load file.DAT with some non-printable ASCII characters.

þBEGNUMþ^TþENDNUMþ^TþBEGATTþ^TþENDATTþ^T^M$
þTM00000001þ^TþTM00000001þ^TþTM00000001þ^TþTM00000001þ^M$

How do I use awk to work with data and remove last column? þENDATTþ^T^ so that output becomes:

þBEGNUMþ^TþENDNUMþ^TþBEGATTþM$
þTM00000001þ^TþTM00000001þ^TþTM00000001þM$

Note that my delimiters is from a Concordance database

Comma □ (ASCII 20)

Quote þ (ACSII 254)

New Line ® (ASCII 174)

Answer 1

我能够弄清楚

awk -F'\\024' 'BEGIN {OFS = FS; ORS = "\\n"} {$33=""; sub(/\\024$/, ""); print $0}' tmp.dat > final.dat