简体繁体 English

为 Microsoft Azure Blob 存储自动化 Snowpipe - 错误：找不到通道的队列

[英]Automating Snowpipe for Microsoft Azure Blob Storage - error: Queue not found for channel

原文 2022-02-18 17:41:09 4 1 azure/ snowflake-cloud-data-platform/ azure-eventgrid/ azure-queues

I have been trying to set up a snowpipe to ingest data from blob storage in Azure into snowflake, following this guide, I think I have done everything correctly although I am new to azure and snowflake so may have missed something obvious.我一直在尝试设置雪管以将 Azure 中的 blob 存储中的数据提取到雪花中，按照本指南，我认为我已经正确地完成了所有操作，尽管我是 azure 和雪花的新手，所以可能错过了一些明显的东西。 Everything seems to have been set up correctly on both sides, but whenever I check the pipe status using SELECT SYSTEM$PIPE_STATUS('azure_pipe');双方的一切似乎都已正确设置，但每当我使用SELECT SYSTEM$PIPE_STATUS('azure_pipe');检查 pipe 状态时, I get the following: ，我得到以下信息：

{"executionState":"RUNNING","pendingFileCount":0,"notificationChannelName":"https://snowflakedata.queue.core.windows.net/snowflakequeue","numOutstandingMessagesOnChannel":2,"lastReceivedMessageTimestamp":"2022-02-18T13:25:12.107Z","channelErrorMessage":"downloadAttributes error:Queue not found for channel Name=https://snowflakedata2.queue.core.windows.net/snowflakequeue, AccountId=6713, NotificationChannelID=2045, IntegrationID=1784764","lastErrorRecordTimestamp":"2022-02-18T17:32:47.854Z"} {“executionState”：“RUNNING”，“pendingFileCount”：0，“notificationChannelName”：“https://snowflakedata.queue.core.windows.net/snowflakequeue”，“numOutstandingMessagesOnChannel”：2，“lastReceivedMessageTimestamp”：“2022- 02-18T13:25:12.107Z","channelErrorMessage":"downloadAttributes 错误：找不到通道名称的队列=https://snowflakedata2.queue.core.windows.net/snowflakequeue，AccountId=6713，NotificationChannelID=2045，IntegrationID =1784764","lastErrorRecordTimestamp":"2022-02-18T17:32:47.854Z"}

I'm not sure what I have done wrong, the snowflake app has the queue contributor role in azure and I'm fairly sure I set everything else up correctly.我不确定我做错了什么，雪花应用程序在 azure 中具有队列贡献者角色，我相当确定我已正确设置其他所有内容。 If anyone could point me in the right direction as to how to troubleshoot this that would be really helpful!如果有人能指出正确的方向来解决这个问题，那将非常有帮助！

1 个解决方案

I had the same issue as you did just this week when trying to create a Snowpipe for Azure. Using SELECT SYSTEM$PIPE_STATUS('azure_pipe');我在本周尝试为 Azure 创建 Snowpipe 时遇到了与您相同的问题。使用SELECT SYSTEM$PIPE_STATUS('azure_pipe'); gave the exact same error message as you have shown above.给出了与上面显示的完全相同的错误消息。 Thankfully, Snowflake Support has provided me with the answer and an explanation.值得庆幸的是，Snowflake Support 为我提供了答案和解释。

Answer:回答：

Drop all of the objects relating to the Snowpipe (integrations, pipe, stage, etc).删除与 Snowpipe 相关的所有对象（集成、pipe、舞台等）。 Then recreate them in the exact order and specification as shown in this documentation .然后按照本文档中所示的确切顺序和规范重新创建它们。

Explanation:解释：

The issue for me was caused because I kept using create or replace on the objects when I was modifying them (eg changing the comment on a pipe).我的问题是因为我在修改对象时一直在对象上使用创建或替换（例如更改管道上的注释）。 This re-created the object and broke the links between the objects in the Snowpipe and prevented the Snowpipe from working as intended.这重新创建了 object 并断开了 Snowpipe 中对象之间的链接并阻止了 Snowpipe 按预期工作。 Dropping and starting again solved it for me.放弃并重新开始为我解决了这个问题。