steampipe plugin install aws

Table: aws_dynamodb_table_export - Query AWS DynamoDB Table Export using SQL

The AWS DynamoDB Table Export is a feature within the AWS DynamoDB service that allows users to export data from their DynamoDB tables into an Amazon S3 bucket. This operation provides a SQL-compatible export of your DynamoDB data, enabling comprehensive data analysis and large scale exports without impacting the performance of your applications. The exported data can be in one of the following formats: Amazon Ion or DynamoDB JSON.

Table Usage Guide

The aws_dynamodb_table_export table in Steampipe provides you with information about the exports of DynamoDB tables within AWS DynamoDB. This table allows you, as a DevOps engineer, to query export-specific details, including the export time, the status of the export, and the format of the exported data. You can utilize this table to gather insights on exports, such as the time of the last export, the status of ongoing exports, and the format of previously exported data. The schema outlines the various attributes of the DynamoDB table export for you, including the export ARN, export time, export status, and the exported data format.

Examples

Basic info

Explore the status of your AWS DynamoDB table exports to understand when they ended and their respective formats. This can be useful in managing data exports and ensuring they are successfully stored in the correct S3 bucket.

select
arn,
end_time,
export_format,
export_status,
s3_bucket
from
aws_dynamodb_table_export;
select
arn,
end_time,
export_format,
export_status,
s3_bucket
from
aws_dynamodb_table_export;

List exports that are not completed

Identify instances where the export process from AWS DynamoDB tables is still ongoing. This is useful to monitor the progress of data exports and ensure they are completing as expected.

select
arn,
end_time,
export_format,
export_status,
s3_bucket
from
aws_dynamodb_table_export
where
export_status <> 'COMPLETED';
select
arn,
end_time,
export_format,
export_status,
s3_bucket
from
aws_dynamodb_table_export
where
export_status != 'COMPLETED';

List export details from the last 10 days

Explore the details of your recent AWS DynamoDB table exports to ensure they've been completed successfully and sent to the correct S3 bucket. This is particularly useful for maintaining data integrity and tracking export activities over the past 10 days.

select
arn,
end_time,
export_format,
export_status,
export_time,
s3_bucket
from
aws_dynamodb_table_export
where
export_time >= now() - interval '10' day;
select
arn,
end_time,
export_format,
export_status,
export_time,
s3_bucket
from
aws_dynamodb_table_export
where
export_time >= datetime('now', '-10 day');

Schema for aws_dynamodb_table_export

NameTypeOperatorsDescription
_ctxjsonbSteampipe context in JSON form, e.g. connection_name.
account_idtextThe AWS Account ID in which the resource is located.
akasjsonbArray of globally unique identifier strings (also known as) for the resource.
arntext=The Amazon Resource Name (ARN) of the export.
billed_size_bytesbigintThe billable size of the table export.
client_tokentextThe client token that was provided for the export task. A client token makes calls to ExportTableToPointInTimeInput idempotent, meaning that multiple identical calls have the same effect as one single call.
end_timetimestamp with time zoneThe time at which the export task completed.
export_formattextThe format of the exported data. Valid values for ExportFormat are DYNAMODB_JSON or ION.
export_manifesttextThe name of the manifest file for the export task.
export_statustextExport can be in one of the following states: IN_PROGRESS, COMPLETED, or FAILED.
export_timetimestamp with time zonePoint in time from which table data was exported.
failure_codetextStatus code for the result of the failed export.
failure_messagetextExport failure reason description.
item_countbigintThe number of items exported.
partitiontextThe AWS partition in which the resource is located (aws, aws-cn, or aws-us-gov).
regiontextThe AWS Region in which the resource is located.
s3_buckettextThe name of the Amazon S3 bucket containing the export.
s3_bucket_ownertextThe ID of the Amazon Web Services account that owns the bucket containing the export.
s3_prefixtextThe Amazon S3 bucket prefix used as the file name and path of the exported snapshot.
s3_sse_algorithmtextType of encryption used on the bucket where export data is stored.
s3_sse_kms_key_idtextThe ID of the KMS managed key used to encrypt the S3 bucket where export data is stored (if applicable).
start_timetimestamp with time zoneThe time at which the export task began.
table_arntextThe Amazon Resource Name (ARN) of the table that was exported.
table_idtextUnique ID of the table that was exported.

Export

This table is available as a standalone Exporter CLI. Steampipe exporters are stand-alone binaries that allow you to extract data using Steampipe plugins without a database.

You can download the tarball for your platform from the Releases page, but it is simplest to install them with the steampipe_export_installer.sh script:

/bin/sh -c "$(curl -fsSL https://steampipe.io/install/export.sh)" -- aws

You can pass the configuration to the command with the --config argument:

steampipe_export_aws --config '<your_config>' aws_dynamodb_table_export