使用新的 Azure.Storage.Blobs 时如何计算存储帐户中 Blob 存储容器的总大小

Question

I have been using Microsoft.Azure.Storage.Blob for past year or two and this is how I was calculating the size of all containers:

    var myStorageAccount = CloudStorageAccount.Parse(myConnectionString, string.Empty));
    var myClient = myStorageAccount.CreateCloudBlobClient();

    var myContainers = myClient.ListContainers();

    containerSize = myContainers .Sum(container => 
      container.ListBlobs(null, true).Cast<CloudBlockBlob>().Sum(blobItem => blobItem.Properties.Length));

However, that package is now deprecated and I have upgraded to use Azure.Storage.Blobs .

I tried to use the ListContainers example from here , but it looks like it needs C# 8:

async static Task ListContainers(BlobServiceClient blobServiceClient, 
                                string prefix, 
                                int? segmentSize)
{
    string continuationToken = string.Empty;

    try
    {
        do
        {
            // Call the listing operation and enumerate the result segment.
            // When the continuation token is empty, the last segment has been returned
            // and execution can exit the loop.
            var resultSegment = 
                blobServiceClient.GetBlobContainersAsync(BlobContainerTraits.Metadata, prefix, default)
                .AsPages(continuationToken, segmentSize);
            await foreach (Azure.Page<BlobContainerItem> containerPage in resultSegment)
            {
                foreach (BlobContainerItem containerItem in containerPage.Values)
                {
                    Console.WriteLine("Container name: {0}", containerItem.Name);
                }

                // Get the continuation token and loop until it is empty.
                continuationToken = containerPage.ContinuationToken;

                Console.WriteLine();
            }

        } while (continuationToken != string.Empty);
    }
    catch (RequestFailedException e)
    {
        Console.WriteLine(e.Message);
        Console.ReadLine();
        throw;
    }
}

I am also not sure if looping through it is the right way to get the total size of the containers in the storage account.

Can someone please help? Thank you.

Answer 1

I don't know a better way then looping trough blobs. I modified given by you example

wchich works in C# 8.0

async static Task<Dictionary<string, long>> ListContainers(BlobServiceClient blobServiceClient,
                                        string connectionString,
                                        string prefix,
                                        int? segmentSize)
{
    string continuationToken = string.Empty;
    var sizes = new Dictionary<string, long>();
    try
    {

        do
        {
            // Call the listing operation and enumerate the result segment.
            // When the continuation token is empty, the last segment has been returned
            // and execution can exit the loop.
            var resultSegment =
                blobServiceClient.GetBlobContainersAsync(BlobContainerTraits.Metadata, prefix, default)
                .AsPages(continuationToken, segmentSize);
            await foreach (Azure.Page<BlobContainerItem> containerPage in resultSegment)
            {

                foreach (BlobContainerItem containerItem in containerPage.Values)
                {
                    BlobContainerClient container = new BlobContainerClient(connectionString, containerItem.Name);

                    var size = container.GetBlobs().Sum(b => b.Properties.ContentLength.GetValueOrDefault());

                    sizes.Add(containerItem.Name, size);

                    Console.WriteLine("Container name: {0} size: {1}", containerItem.Name.PadRight(30), size);
                }

                // Get the continuation token and loop until it is empty.
                continuationToken = containerPage.ContinuationToken;

                Console.WriteLine();
            }

        } while (continuationToken != string.Empty);

        return sizes;
    }
    catch (RequestFailedException e)
    {
        Console.WriteLine(e.Message);
        Console.ReadLine();
        throw;
    }
}

and this one for C# 7.x (to compile you just need the ToListAsync() method, which is in the System.Linq.Async NuGet package. )

async static Task<Dictionary<string, long>> ListContainers(BlobServiceClient blobServiceClient,
                                        string connectionString,
                                        string prefix,
                                        int? segmentSize)
        {
            string continuationToken = string.Empty;
            var sizes = new Dictionary<string, long>();
            try
            {

                do
                {
                    // Call the listing operation and enumerate the result segment.
                    // When the continuation token is empty, the last segment has been returned
                    // and execution can exit the loop.
                    var resultSegment =
                        await blobServiceClient.GetBlobContainersAsync(BlobContainerTraits.Metadata, prefix, default)
                        .AsPages(continuationToken, segmentSize).ToListAsync();
                     foreach (Azure.Page<BlobContainerItem> containerPage in resultSegment)
                    {

                        foreach (BlobContainerItem containerItem in containerPage.Values)
                        {
                            BlobContainerClient container = new BlobContainerClient(connectionString, containerItem.Name);

                            var size = container.GetBlobs().Sum(b => b.Properties.ContentLength.GetValueOrDefault());

                            sizes.Add(containerItem.Name, size);

                            Console.WriteLine("Container name: {0} size: {1}", containerItem.Name.PadRight(30), size);
                        }

                        // Get the continuation token and loop until it is empty.
                        continuationToken = containerPage.ContinuationToken;

                        Console.WriteLine();
                    }

                } while (continuationToken != string.Empty);

                return sizes;
            }
            catch (RequestFailedException e)
            {
                Console.WriteLine(e.Message);
                Console.ReadLine();
                throw;
            }
        }

I just ran this code for .NET 4.8 using these packages:

<?xml version="1.0" encoding="utf-8"?>
<packages>
  <package id="Azure.Core" version="1.4.1" targetFramework="net48" />
  <package id="Azure.Storage.Blobs" version="12.6.0" targetFramework="net48" />
  <package id="Azure.Storage.Common" version="12.5.2" targetFramework="net48" />
  <package id="Microsoft.Bcl.AsyncInterfaces" version="1.1.0" targetFramework="net48" />
  <package id="System.Buffers" version="4.5.0" targetFramework="net48" />
  <package id="System.Diagnostics.DiagnosticSource" version="4.6.0" targetFramework="net48" />
  <package id="System.Linq.Async" version="4.1.1" targetFramework="net48" />
  <package id="System.Memory" version="4.5.3" targetFramework="net48" />
  <package id="System.Numerics.Vectors" version="4.5.0" targetFramework="net48" />
  <package id="System.Runtime.CompilerServices.Unsafe" version="4.6.0" targetFramework="net48" />
  <package id="System.Text.Encodings.Web" version="4.6.0" targetFramework="net48" />
  <package id="System.Text.Json" version="4.6.0" targetFramework="net48" />
  <package id="System.Threading.Tasks.Extensions" version="4.5.2" targetFramework="net48" />
  <package id="System.ValueTuple" version="4.5.0" targetFramework="net48" />
</packages>

and all was fine.