如何从 tsv 文件中删除低值

Question

I have this TSV file:

    kind        10
    men        9
    number        8
    animated        7
    blade        6
    jolly        5
    manage        4
    move         3
    complete        2
    meat        1

And I would like to remove all words which have less than the number 5 next to them.

So only:

    Output: 
    kind        10
    men        9
    number        8
    animated        7
    blade        6
    jolly        5

I would like to do this as python code. I was thinking maybe I could load it in a list and from there look at the number, and if it's less than 5 it's removed. But how to do that I'm not sure.

Something like this:

    new_file = open(the_file,encoding="utf-8")
    data = new_file.readlines()
    new_list = []
    for values in data:
        if values > 5:
            new_list.append(values)









   

Answer 1

Welcome to the community. As others have suggested, you may very well use pandas. If you want to use the csv module, you can do something like the following:

import csv

tsv_file = open("example.tsv")
read_tsv = list(csv.reader(tsv_file, delimiter="\t"))

for row in read_tsv:
    if float(row[1]) < 5:
        read_tsv.remove(row)

That reads the file into a list of lists, each row being one list. If the value its always gonna be the second one, you can read it like that and eliminate the row from the bigger list. Hope it helped!

EDIT: I'm sorry, I just saw your comment. Try something else like what I edited up in this post (I did a couple of assumptions about CSV Reader that were wrong, but I think that it is fixed now. Hope it works.

Answer 2

If you're looking at this kind of files I would really look into Pandas. That's basically Excel on steroids.

The code would look more or less like this:

df = pd.read_csv('file.tsv', sep='\t')
df = df.loc[4 < df['column_name']]

Answer 3

First you should read in the file. This will give you a list with each line from the file:

with open('test.txt', 'rt') as file:
    content = file.readlines()

Now its enough to check the integer made from the last to digits of each line (after stripping the newline character). Compare it to 5 and then write it back to the file, like this:

with open('test.txt', 'wt') as file:
    file.writelines([c for c in content if int(c.strip()[-2:]) >= 5])