将批量插入添加到Web API

Question

We have an API that companies use to add products to our catalog system.

The issue is that currently it is a 1 item at a time setup, which to a vendor that will input 10-20k entries at a time, is a massive pain.

I'm looking to add a bulk option to the api but unsure how to add synch support to this.

I'm using MVC 5 & Web API 2 and .NET 4.5

Everything I find on this is talking about uploading not bulk inserting records.

EDIT:

I should add that the user would be chunking the data to 20-50 records at a time.

Answer 1

You are probably finding those references to uploads due to the fact that the best way to handle what you describe is to provide functionality to upload a file of products and then process the file server side.

If you add a method to accept a blob of 20k entries in your api then you will have to set your max http request/json size to an astronomical number. Not to mention it is a daunting task to provide feedback to the client while the data is being transferred.

By using an async file upload you can provide file transfer progress to the user and the whole process will be less error prone. You can break the processing into chunks.

Bulk insert/copy is more of a database term that describes a more efficient way to upload large data into a database.