How to count element in JSON and remove its duplicate with python

Question

I have below code to count the element in JSON and remove its duplicate.
My problem is when it need to read thousand line of data, this code take long time to finish.
Can anyone help me if we have better way to do this?

#count json element
BattleAmount = []

    for i in DATA:
        amount = DATA.count(i)
        j = copy.deepcopy(i)
        j['md']["amount"] = j['md']["amount"] + amount
        BattleAmount.append(j)
    print("Number of BattleAmount are ", len(BattleAmount))

#remove duplicate
    duplicates=[]

    for i in BattleAmount:
        if BattleAmount.count(i)>1:
                if i not in duplicates:
                    duplicates.append(i)

JSON as this format
[{"_id": {"$oid": "SL"}, "md": {"mana": 24, "rule_set": "Standard", "amount": 12}, "team": {other dict here}

thank you

Answer 1

If you do not care about the order of your elements in BattleAmount you can just use set() function

unique_elements = set(BattleAmount)