C# MongoDb 从 stream 插入整个集合

Question

I have a process that archives MongoDb collections by getting an IAsyncCursor and writing the raw bytes out to an Azure Blob stream. 这似乎非常有效并且有效。 这是工作代码。

var cursor = await clientDb.GetCollection<RawBsonDocument>(collectionPath).Find(new BsonDocument()).ToCursorAsync();
while (cursor.MoveNext())
    foreach (var document in cursor.Current)
    {
        var bytes = new byte[document.Slice.Length];
        document.Slice.GetBytes(0, bytes, 0, document.Slice.Length);
        blobStream.Write(bytes, 0, bytes.Length);
    }

However, in order to move this data from the archive back into MongoDb, the only way I've figured out how to do it is to load the entire raw byte array into a memory stream and then .InsertOneAsync() in to MongoDb. 这对于较小的 collections 确实有效，但对于非常大的 collections 我收到 MongoDb 错误。 此外，这显然不是很有效的 memory。 有什么方法可以将 stream 原始字节数据转换为 MongoDb，或者像我在读取时那样使用 cursor？

var rawRef = clientDb.GetCollection<RawBsonDocument>(collectionPath);
using (var ms = new MemoryStream())
{
    await stream.CopyToAsync(ms);
    var bytes = ms.ToArray();
    var rawBson = new RawBsonDocument(bytes);
    await rawRef.InsertOneAsync(rawBson);
}

如果集合太大，这是我得到的错误。

MongoDB.Driver.MongoConnectionException : An exception occurred while sending a message to the server.
---- System.IO.IOException : Unable to write data to the transport connection: An established connection was aborted by the software in your host machine..
-------- System.Net.Sockets.SocketException : An established connection was aborted by the software in your host machine.

Answer 1

无需将 stream 整体复制到 byte-Array 并将其解析为RawBsonDocument ，您可以逐个解析文档，例如：

while (stream.Position < stream.Length)
{
    var rawBson = BsonSerializer.Deserialize<RawBsonDocument>(stream);
    await rawRef.InsertOneAsync(rawBson);
}

stream 将以一个为单位读取。 上面的示例将文档直接插入到数据库中。 如果要批量插入，可以在列表中收集合理数量的文档并使用InsertManyAsync 。