在大泡菜数据上使用 collections.Counter

Question

I have a pickle file with over a million words in it. The pickle file can be downloaded from here .

I want to use Counter on these words to sort them. Here's my code:

with open('data/words.pkl', 'rb') as f:
    data = list(pickle.load(f))

print(Counter(data).most_common(3))

The printed result changes every time, but it's usually like this:

[('', 1), ('fraksiyonal', 1), ('editado', 1)]

So, it seems to be not counting the words and every word's occurrence is 1. What am I doing wrong?

Edit: As an example of how data list looks:

print(data[0:10])

Result:

['', 'hillview', 'dipnota', 'дол', 'censusi', 'quathie', 'kalacağının', 'stralauerstrasse', 'sbaglio', 'keny']

Answer 1

The problem is with your data. In a comment you said,

I changed it to list because pickle load data is a set object

Sets can't contain duplicates, hence why the counts are always 1.

---

due credit to jasonharper for posting the comment that figured it out