如何從python中的10000行一次讀取/處理100行？

Question

如何一次通過/處理100行或以下的行try:

receipt_dict = {}
with open("data.txt", "r") as plain_text: // ** 10000+ lines **
    for line in plain_text:
        hash_value = line.strip()
        receipt_dict[hash_value] = 1



try:
    bitcoind.sendmany("", receipt_dict) // **here must loop 100 at a time**

Answer 1

將其作為字典list進行處理，並跟蹤每個字典的大小：

receipt_dicts = []
current_dict = {}
with open("data.txt", "r") as plain_text: # ** 10000+ lines **
    for line in plain_text:
        if len(current_dict) == 100:
            receipt_dict.append(current_dict)
            current_dict = {}
        current_dict[line.strip()] = 1
    receipt_dict.append(current_dict)

然后，您可以遍歷此list並一次處理一個字典。

Answer 2

帶發電機。 在這里， load_data_chunks數據累積到receipt_dict直到其大小超過chunk_size然后將其返回到下面的主循環中。

def load_data_chunks(path, fname, chunk_size): 
    receipt_dict = {}

    with open(fname, "r") as plain_text:
        for line in plain_text:
            hash_value = line.strip()
            receipt_dict[hash_value] = 1

            if len(receipt_dict) > chunk_size:
                yield receipt_dict
                receipt_dict = {}

    yield receipt_dict

for chunk in load_data_chunks("data.txt", 100):
    try:
        ...