如何计算 JSON 中的元素并使用 python 删除其重复项

Question

I have below code to count the element in JSON and remove its duplicate.
My problem is when it need to read thousand line of data, this code take long time to finish.
Can anyone help me if we have better way to do this?

#count json element
BattleAmount = []

    for i in DATA:
        amount = DATA.count(i)
        j = copy.deepcopy(i)
        j['md']["amount"] = j['md']["amount"] + amount
        BattleAmount.append(j)
    print("Number of BattleAmount are ", len(BattleAmount))

#remove duplicate
    duplicates=[]

    for i in BattleAmount:
        if BattleAmount.count(i)>1:
                if i not in duplicates:
                    duplicates.append(i)

JSON as this format
[{"_id": {"$oid": "SL"}, "md": {"mana": 24, "rule_set": "Standard", "amount": 12}, "team": {other dict here}

thank you

Answer 1

If you do not care about the order of your elements in BattleAmount you can just use set() function

unique_elements = set(BattleAmount)