Table: aws_emr_cluster_metric_is_idle - Query AWS EMR Cluster Metrics using SQL
The AWS Elastic MapReduce (EMR) Cluster is a managed service that simplifies big data processing, with capabilities to analyze and process vast amounts of data quickly. It utilizes popular distributed frameworks such as Apache Hadoop and Spark. The 'is_idle' metric indicates whether the cluster is idle or not, helping to optimize resource utilization and cost.
Table Usage Guide
The aws_emr_cluster_metric_is_idle
table in Steampipe provides you with information about the IsIdle metric of AWS Elastic MapReduce (EMR) Clusters. This table enables you, as a DevOps engineer, to query details related to the idle state of EMR clusters, including the cluster's ID, the namespace of the metric, and the timestamp of the metric. You can utilize this table to gather insights on cluster utilization, such as identifying underused resources and optimizing resource allocation. The schema outlines the various attributes of the EMR Cluster IsIdle metric for you, including the cluster ID, metric namespace, and metric timestamp.
The aws_emr_cluster_metric_is_idle
table provides you with metric statistics at 5 minute intervals for the most recent 5 days.
Examples
Basic info
Assess the performance of your AWS EMR clusters by analyzing their idle metrics over time. This helps in optimizing resource usage by identifying periods of low activity or inactivity.
select id, timestamp, minimum, maximum, average, sample_countfrom aws_emr_cluster_metric_is_idleorder by id, timestamp;
select id, timestamp, minimum, maximum, average, sample_countfrom aws_emr_cluster_metric_is_idleorder by id, timestamp;
Schema for aws_emr_cluster_metric_is_idle
Name | Type | Operators | Description |
---|---|---|---|
_ctx | jsonb | Steampipe context in JSON form. | |
account_id | text | =, !=, ~~, ~~*, !~~, !~~* | The AWS Account ID in which the resource is located. |
average | double precision | The average of the metric values that correspond to the data point. | |
id | text | The unique identifier for the cluster. | |
maximum | double precision | The maximum metric value for the data point. | |
metric_name | text | The name of the metric. | |
minimum | double precision | The minimum metric value for the data point. | |
namespace | text | The metric namespace. | |
partition | text | The AWS partition in which the resource is located (aws, aws-cn, or aws-us-gov). | |
region | text | The AWS Region in which the resource is located. | |
sample_count | double precision | The number of metric values that contributed to the aggregate value of this data point. | |
sp_connection_name | text | =, !=, ~~, ~~*, !~~, !~~* | Steampipe connection name. |
sp_ctx | jsonb | Steampipe context in JSON form. | |
sum | double precision | The sum of the metric values for the data point. | |
timestamp | timestamp with time zone | The time stamp used for the data point. | |
unit | text | The standard unit for the data point. |
Export
This table is available as a standalone Exporter CLI. Steampipe exporters are stand-alone binaries that allow you to extract data using Steampipe plugins without a database.
You can download the tarball for your platform from the Releases page, but it is simplest to install them with the steampipe_export_installer.sh
script:
/bin/sh -c "$(curl -fsSL https://steampipe.io/install/export.sh)" -- aws
You can pass the configuration to the command with the --config
argument:
steampipe_export_aws --config '<your_config>' aws_emr_cluster_metric_is_idle