steampipe plugin install aws

Table: aws_kinesis_firehose_delivery_stream - Query AWS Kinesis Firehose Delivery Stream using SQL

The AWS Kinesis Firehose Delivery Stream is a fully managed service that makes it easy to capture, transform, and load data streams into AWS data stores for near real-time analytics with existing business intelligence tools. It can capture, transform, and deliver streaming data to Amazon S3, Amazon Redshift, Amazon Elasticsearch Service, and Splunk, enabling near real-time analytics with existing business intelligence tools and dashboards. It is a key data streaming solution as part of the AWS ecosystem.

Table Usage Guide

The aws_kinesis_firehose_delivery_stream table in Steampipe provides you with information about each Kinesis Firehose Delivery Stream within AWS. This table allows you, as a DevOps engineer, to query delivery stream-specific details, including the delivery stream name, status, creation time, and associated metadata. You can utilize this table to gather insights on delivery streams, such as the status of the stream, its creation time, and the destinations configured for the stream. The schema outlines the various attributes of the Kinesis Firehose Delivery Stream, including the delivery stream ARN, delivery stream type, delivery stream status, and more for you.

Examples

Basic info

Explore which AWS Kinesis Firehose streams are active and when they were created to better manage and monitor data flow. This can be useful for auditing purposes or to optimize resource allocation.

select
delivery_stream_name,
arn,
create_timestamp,
delivery_stream_type
from
aws_kinesis_firehose_delivery_stream;
select
delivery_stream_name,
arn,
create_timestamp,
delivery_stream_type
from
aws_kinesis_firehose_delivery_stream;

List inactive delivery streams

Determine the areas in which delivery streams are inactive within the AWS Kinesis Firehose service. This is useful for identifying potential issues or bottlenecks in your data flow.

select
delivery_stream_name,
arn,
delivery_stream_status,
create_timestamp,
delivery_stream_type
from
aws_kinesis_firehose_delivery_stream
where
delivery_stream_status != 'ACTIVE';
select
delivery_stream_name,
arn,
delivery_stream_status,
create_timestamp,
delivery_stream_type
from
aws_kinesis_firehose_delivery_stream
where
delivery_stream_status != 'ACTIVE';

List delivery streams that are not encrypted

Identify instances where your Kinesis Firehose delivery streams are not encrypted. This is crucial for ensuring the security of your data in transit.

select
delivery_stream_name,
arn,
delivery_stream_status,
create_timestamp,
delivery_stream_type,
delivery_stream_encryption_configuration ->> 'Status' as encryption_status
from
aws_kinesis_firehose_delivery_stream
where
delivery_stream_encryption_configuration ->> 'Status' = 'DISABLED';
select
delivery_stream_name,
arn,
delivery_stream_status,
create_timestamp,
delivery_stream_type,
json_extract(
delivery_stream_encryption_configuration,
'$.Status'
) as encryption_status
from
aws_kinesis_firehose_delivery_stream
where
json_extract(
delivery_stream_encryption_configuration,
'$.Status'
) = 'DISABLED';

List delivery streams for a specific delivery stream type

Determine the areas in which specific types of delivery streams are being used within the AWS Kinesis Firehose service. This can help in managing and optimizing the use of different delivery stream types.

select
delivery_stream_name,
arn,
delivery_stream_status,
create_timestamp,
delivery_stream_type
from
aws_kinesis_firehose_delivery_stream
where
delivery_stream_type = 'DirectPut';
select
delivery_stream_name,
arn,
delivery_stream_status,
create_timestamp,
delivery_stream_type
from
aws_kinesis_firehose_delivery_stream
where
delivery_stream_type = 'DirectPut';

List delivery streams with at least one failure

Identify instances where delivery streams have experienced at least one failure. This is useful for diagnosing issues and ensuring reliable data delivery within AWS Kinesis.

select
delivery_stream_name,
arn,
delivery_stream_status,
delivery_stream_type,
failure_description
from
aws_kinesis_firehose_delivery_stream
where
failure_description is not null;
select
delivery_stream_name,
arn,
delivery_stream_status,
delivery_stream_type,
failure_description
from
aws_kinesis_firehose_delivery_stream
where
failure_description is not null;

Schema for aws_kinesis_firehose_delivery_stream

NameTypeOperatorsDescription
_ctxjsonbSteampipe context in JSON form.
account_idtext=, !=, ~~, ~~*, !~~, !~~*The AWS Account ID in which the resource is located.
akasjsonbArray of globally unique identifier strings (also known as) for the resource.
arntextThe Amazon Resource Name (ARN) of the delivery stream.
create_timestamptimestamp with time zoneThe date and time that the delivery stream was created.
delivery_stream_encryption_configurationjsonbIndicates the server-side encryption (SSE) status for the delivery stream.
delivery_stream_nametext=The name of the delivery stream.
delivery_stream_statustextThe server-side encryption type used on the stream.
delivery_stream_typetext=The delivery stream type.
destinationsjsonbThe destinations for the stream.
failure_descriptionjsonbProvides details in case one of the following operations fails due to an error related to KMS: CreateDeliveryStream, DeleteDeliveryStream, StartDeliveryStreamEncryption,StopDeliveryStreamEncryption.
has_more_destinationsbooleanIndicates whether there are more destinations available to list.
last_update_timestamptimestamp with time zoneThe date and time that the delivery stream was last updated.
partitiontextThe AWS partition in which the resource is located (aws, aws-cn, or aws-us-gov).
regiontextThe AWS Region in which the resource is located.
sourcejsonbIf the DeliveryStreamType parameter is KinesisStreamAsSource, a SourceDescription object describing the source Kinesis data stream.
sp_connection_nametext=, !=, ~~, ~~*, !~~, !~~*Steampipe connection name.
sp_ctxjsonbSteampipe context in JSON form.
tagsjsonbA map of tags for the resource.
tags_srcjsonbA list of tags associated with the delivery stream.
titletextTitle of the resource.
version_idtextThe version id of the stream. Each time the destination is updated for a delivery stream, the version ID is changed, and the current version ID is required when updating the destination

Export

This table is available as a standalone Exporter CLI. Steampipe exporters are stand-alone binaries that allow you to extract data using Steampipe plugins without a database.

You can download the tarball for your platform from the Releases page, but it is simplest to install them with the steampipe_export_installer.sh script:

/bin/sh -c "$(curl -fsSL https://steampipe.io/install/export.sh)" -- aws

You can pass the configuration to the command with the --config argument:

steampipe_export_aws --config '<your_config>' aws_kinesis_firehose_delivery_stream