[英]Azure architecture best suited to save JSON from API to a Data Lake Store?
I am looking forward to build an endpoint capable of receiving JSON objects and saving them into ADLS. 我期待构建一个能够接收JSON对象并将其保存到ADLS的终结点。 So far I have tried several different combinations using Functions, Event Hubs, and Stream Analytics.
到目前为止,我已经尝试使用Function,Event Hubs和Stream Analytics进行几种不同的组合。 The problem is: no solution so far seems ideal.
问题是:到目前为止,没有解决方案是理想的。
TL;DR In my scenario, I have a few set of users that will send me JSON data through an API, and I need to save it inside ADLS, separated by user. TL; DR在我的场景中,我有几组用户将通过API向我发送JSON数据,我需要将其保存在ADLS中,并按用户分开。 What is the best way of doing so?
最好的方法是什么?
Could anyone shed me some light? 谁能给我一些启示? Thanks in advance.
提前致谢。
WARNING: LONG TEXT AHEAD 警告:长文本
Let me explain my findings so far: 让我解释一下到目前为止的发现:
Functions 职能
Advantages 好处
Disadvantages 缺点
Event Hub 活动中心
Advantages 好处
Disadvantages 缺点
Functions + Event Hub 功能+事件中心
Using Event Hub with Functions mitigate Functions disadvantages, but have the same drawbacks (except auth) of Event Hub 将事件中心与函数一起使用可减轻函数的缺点,但具有与事件中心相同的缺点(auth除外)
Functions + Event Hub + Stream Analytics 功能+事件中心+流分析
Although I would be able to have a single event hub without capture, using Stream Analytics SQL as a filter to direct each user's data to its specific folder, it would be a limiting factor. 尽管我可以拥有一个不带捕获功能的事件中心,但使用Stream Analytics SQL作为筛选器将每个用户的数据定向到其特定文件夹,这将是一个限制因素。 I have tried it and it gets slower as the SQL gets bigger.
我已经尝试过了,随着SQL变大,它变得越来越慢。
IoT Hub 物联网中心
IoT Hub has routing, but it is not as dynamic as I require. IoT中心具有路由,但是它没有我所需要的动态。
Could anyone shed me some light? 谁能给我一些启示? Thanks in advance.
提前致谢。
I don't quite see the disadvantages of using only Azure Functions to write data to ADLS. 我不太明白仅使用Azure Functions将数据写入ADLS的弊端。
声明:本站的技术帖子网页,遵循CC BY-SA 4.0协议,如果您需要转载,请注明本站网址或者原文地址。任何问题请咨询:yoyou2525@163.com.