使用Python获取Azure Blob存储中的容器大小

Question

I am trying to use block_blob_service library in Python in order to get the sizes of all containers in an Azure blob storage. The following works, but takes too long (around 10 minutes for 50TB blob).

Is there a quicker way?

block_blob_service = BlockBlobService(account_name=azureAccount, account_key=azurekey)
containers = block_blob_service.list_containers()
for c in containers:
        contName = c.name
        generator = block_blob_service.list_blobs(contName)
        contSize = 0
        contNum = 0
        for blob in generator: 
            contSize += blob.properties.content_length
            contNum += 1
        print(contName + " : " + str(contSize/1000000) + " MB" + " in " + str(contNum) + " blobs")

Answer 1

In addition to the SDK, you can use PowerShell script or a CLI script to get container size.

Also , you can view the container size on the portal directly.

I think the main issue of executing so long is that the storage blobs are too fragmented to increase the number of loops, compared to the capacity of the storage blobs.

So , I suggest you put the calculation in Azure Function to ease the pressure of your application.

Hope it helps you.