AWS Put Subscription Filter for Kinesis Firehose using Cloudformation - 检查给定的 Firehose stream 是否处于活动状态 state

Question

Following this guide and creating a Kinesis Firehose Stream.

I have followed the guide and when I get to creating a subscription filter (step 12), I encounter this error when trying to send to S3:

An error occurred (InvalidParameterException) when calling the PutSubscriptionFilter operation: Could not deliver test message to specified Firehose stream. Check if the given Firehose stream is in ACTIVE state.

I can confirm that the stream is active and I can send test data via the console and it arrives in S3 as expected.

This is the command I am running (changed my account id):

aws logs put-subscription-filter --log-group-name "myLogGroup" --filter-name "Destination" --filter-pattern "{$.userIdentity.type = Root}" --destination-arn "arn:aws:firehose:ap-southeast-1:1234567890:deliverystream/my-delivery-stream" --role-arn "arn:aws:iam::1234567890:role/CWLtoKinesisFirehoseRole"

I have checked the trusted entities and the role has priviliges to logs and firehose. Any ideas?

Answer 1

I also struggle with this for a long time, for me it was those 2 gothca's:

step 4 in the guide: make sure to change to bucket name to you bucket:

step 8:!!:

make sure to put your account ID it is not highlighted:

Answer 2

I am sure you already know how to configure logs subscription filter so not adding steps in my answer

1. Go to firehose and check logs is your firehose has access to execute lambda,if not please add required role.
2. Now start dummy data stream using firehose test and see is your data is moving till lambda or S3.
3. check cloud trail and cloud watch logs and see if found any error.
4. Open your IAM role and check all required role added to your role, now click trust relationship add- "logs group ","IAM" and component name in my case its "Ec2"

Hope this will helpful to resolve your issue.

• https://docs.aws.amazon.com/AmazonCloudWatch/latest/logs/SubscriptionFilters.html#FirehoseExample