Table: aws_dynamodb_table_export - Query AWS DynamoDB Table Export using SQL

The AWS DynamoDB Table Export is a feature within the AWS DynamoDB service that allows users to export data from their DynamoDB tables into an Amazon S3 bucket. This operation provides a SQL-compatible export of your DynamoDB data, enabling comprehensive data analysis and large scale exports without impacting the performance of your applications. The exported data can be in one of the following formats: Amazon Ion or DynamoDB JSON.

Table Usage Guide

The aws_dynamodb_table_export table in Steampipe provides you with information about the exports of DynamoDB tables within AWS DynamoDB. This table allows you, as a DevOps engineer, to query export-specific details, including the export time, the status of the export, and the format of the exported data. You can utilize this table to gather insights on exports, such as the time of the last export, the status of ongoing exports, and the format of previously exported data. The schema outlines the various attributes of the DynamoDB table export for you, including the export ARN, export time, export status, and the exported data format.

Examples

Basic info

Explore the status of your AWS DynamoDB table exports to understand when they ended and their respective formats. This can be useful in managing data exports and ensuring they are successfully stored in the correct S3 bucket.

select
  arn,
  end_time,
  export_format,
  export_status,
  s3_bucket
from
  aws_dynamodb_table_export;

select
  arn,
  end_time,
  export_format,
  export_status,
  s3_bucket
from
  aws_dynamodb_table_export;

List exports that are not completed

Identify instances where the export process from AWS DynamoDB tables is still ongoing. This is useful to monitor the progress of data exports and ensure they are completing as expected.

select
  arn,
  end_time,
  export_format,
  export_status,
  s3_bucket
from
  aws_dynamodb_table_export
where
  export_status <> 'COMPLETED';

select
  arn,
  end_time,
  export_format,
  export_status,
  s3_bucket
from
  aws_dynamodb_table_export
where
  export_status != 'COMPLETED';

List export details from the last 10 days

Explore the details of your recent AWS DynamoDB table exports to ensure they've been completed successfully and sent to the correct S3 bucket. This is particularly useful for maintaining data integrity and tracking export activities over the past 10 days.

select
  arn,
  end_time,
  export_format,
  export_status,
  export_time,
  s3_bucket
from
  aws_dynamodb_table_export
where
  export_time >= now() - interval '10' day;

select
  arn,
  end_time,
  export_format,
  export_status,
  export_time,
  s3_bucket
from
  aws_dynamodb_table_export
where
  export_time >= datetime('now', '-10 day');

Query examples

s3_buckets_for_dynamodb_table

Schema for aws_dynamodb_table_export

Name	Type	Operators	Description
_ctx	jsonb		Steampipe context in JSON form.
account_id	text	=, !=, ~~, ~~, !~~, !~~	The AWS Account ID in which the resource is located.
akas	jsonb		Array of globally unique identifier strings (also known as) for the resource.
arn	text	=	The Amazon Resource Name (ARN) of the export.
billed_size_bytes	bigint		The billable size of the table export.
client_token	text		The client token that was provided for the export task. A client token makes calls to ExportTableToPointInTimeInput idempotent, meaning that multiple identical calls have the same effect as one single call.
end_time	timestamp with time zone		The time at which the export task completed.
export_format	text		The format of the exported data. Valid values for ExportFormat are DYNAMODB_JSON or ION.
export_manifest	text		The name of the manifest file for the export task.
export_status	text		Export can be in one of the following states: IN_PROGRESS, COMPLETED, or FAILED.
export_time	timestamp with time zone		Point in time from which table data was exported.
export_type	text		The type of export that was performed. Valid values are FULL_EXPORT or INCREMENTAL_EXPORT.
failure_code	text		Status code for the result of the failed export.
failure_message	text		Export failure reason description.
incremental_export_specification	jsonb		Optional object containing the parameters specific to an incremental export.
item_count	bigint		The number of items exported.
partition	text		The AWS partition in which the resource is located (aws, aws-cn, or aws-us-gov).
region	text		The AWS Region in which the resource is located.
s3_bucket	text		The name of the Amazon S3 bucket containing the export.
s3_bucket_owner	text		The ID of the Amazon Web Services account that owns the bucket containing the export.
s3_prefix	text		The Amazon S3 bucket prefix used as the file name and path of the exported snapshot.
s3_sse_algorithm	text		Type of encryption used on the bucket where export data is stored.
s3_sse_kms_key_id	text		The ID of the KMS managed key used to encrypt the S3 bucket where export data is stored (if applicable).
sp_connection_name	text	=, !=, ~~, ~~, !~~, !~~	Steampipe connection name.
sp_ctx	jsonb		Steampipe context in JSON form.
start_time	timestamp with time zone		The time at which the export task began.
table_arn	text		The Amazon Resource Name (ARN) of the table that was exported.
table_id	text		Unique ID of the table that was exported.

Export

This table is available as a standalone Exporter CLI. Steampipe exporters are stand-alone binaries that allow you to extract data using Steampipe plugins without a database.

You can download the tarball for your platform from the Releases page, but it is simplest to install them with the steampipe_export_installer.sh script:

/bin/sh -c "$(curl -fsSL https://steampipe.io/install/export.sh)" -- aws

You can pass the configuration to the command with the --config argument:

steampipe_export_aws --config '<your_config>' aws_dynamodb_table_export