从文本文件中删除特定行

Question

I have a huge log file containing a bunch of lines like:

...
Useful stuff
...
Finished 0 of 435
Finished 1 of 435
...
Finished 435 of 435
...
Other useful stuff

How to elegantly remove all the "Finished n of N" lines except "Finished N of N"?

This shall be done on Windows, with eg Python or GNU tools.

Answer 1

You can use awk :

awk '/^Finished/ && $2!=$4 {next}1' logfile
...
Useful stuff
...
...
Finished 435 of 435
...
Other useful stuff

Note: For windows you might have to use double quotes instead of single quotes.

Answer 2

You can try with empty string substitution

^Finished (\d+) of (?!\1)\d+$

Here is DEMO

Debuggex Demo

sample code:

import re
p = re.compile(ur'^Finished (\d+) of (?!\1)\d+$', re.MULTILINE | re.IGNORECASE)
test_str = u"..."
subst = u""

result = re.sub(p, subst, test_str)

Pattern explanation:

  ^                        the beginning of the string
  Finished                 'Finished '
  (                        group and capture to \1:
    \d+                      digits (0-9) (1 or more times)
  )                        end of \1
   of                      ' of '
  (?!                      look ahead to see if there is not:
    \1                       what was matched by capture \1
  )                        end of look-ahead
  \d+                      digits (0-9) (1 or more times)
  $                        the end of the string

---

EDIT

One slight change in the regex pattern as per the comment below

^Finished (\d+) of (?!\1$)\d+$

DEMO