Table: aws_emr_instance_fleet - Query AWS EMR Instance Fleets using SQL

An AWS EMR Instance Fleet is a component of Amazon EMR that you use to specify the EC2 instances and instance types that Amazon EMR provisions to create a cluster. Instance fleets provide a way to specify a diverse set of instances to accommodate workloads that benefit from a variety of EC2 instance types. They allow you to specify target capacities for On-Demand and Spot instances in terms of instances, vCPUs, or ECUs.

Table Usage Guide

The aws_emr_instance_fleet table in Steampipe provides you with information about instance fleets within AWS Elastic MapReduce (EMR). This table allows you, as a DevOps engineer, to query instance fleet-specific details, including instance type specifications, target capacities, and associated metadata. You can utilize this table to gather insights on instance fleets, such as the current status of instance fleets, the target and provisioned capacities of on-demand and spot instances, and the instance type configurations. The schema outlines the various attributes of the EMR instance fleet for you, including the fleet ID, cluster ID, name, state, instance type specifications, target capacities, and associated tags.

Examples

Basic info

Explore the status and type of your EMR instance fleets in AWS to understand their current operational state and configuration.

select
  id,
  arn,
  cluster_id,
  instance_fleet_type,
  state
from
  aws_emr_instance_fleet;

select
  id,
  arn,
  cluster_id,
  instance_fleet_type,
  state
from
  aws_emr_instance_fleet;

Get the cluster details of the instance fleets

Discover the segments that provide a comprehensive view of the state and name of your clusters within your instance fleets. This can be useful to manage and monitor the health and status of your fleets in AWS Elastic MapReduce (EMR) service.

select
  cluster_id,
  c.name as cluster_name,
  c.state as cluster_state
from
  aws_emr_instance_fleet as f,
  aws_emr_cluster as c
where
  f.cluster_id = c.id;

select
  cluster_id,
  c.name as cluster_name,
  c.state as cluster_state
from
  aws_emr_instance_fleet as f
  join aws_emr_cluster as c on f.cluster_id = c.id;

Get the provisioned & target on demand capacity of the instance fleets

Determine the current and target capacity of your instance fleets to effectively manage resources and plan for future capacity needs. This allows you to optimize your resource utilization and avoid potential over-provisioning or under-provisioning.

select
  cluster_id,
  provisioned_on_demand_capacity,
  target_on_demand_capacity
from
  aws_emr_instance_fleet;

select
  cluster_id,
  provisioned_on_demand_capacity,
  target_on_demand_capacity
from
  aws_emr_instance_fleet;

Schema for aws_emr_instance_fleet

Name	Type	Operators	Description
_ctx	jsonb		Steampipe context in JSON form.
account_id	text	=, !=, ~~, ~~, !~~, !~~	The AWS Account ID in which the resource is located.
akas	jsonb		Array of globally unique identifier strings (also known as) for the resource.
arn	text		The Amazon Resource Name (ARN) specifying the instance fleet.
cluster_id	text		The unique identifier for the cluster.
id	text		The identifier of the instance fleet.
instance_fleet_type	text		The type of the instance fleet. Valid values are MASTER, CORE or TASK.
instance_type_specifications	jsonb		An array of specifications for the instance types that comprise an instance fleet.
launch_specifications	jsonb		Describes the launch specification for an instance fleet.
name	text		The name of the instance fleet.
partition	text		The AWS partition in which the resource is located (aws, aws-cn, or aws-us-gov).
provisioned_on_demand_capacity	bigint		The number of On-Demand units that have been provisioned for the instance fleet to fulfill TargetOnDemandCapacity.
provisioned_spot_capacity	bigint		The number of Spot units that have been provisioned for this instance fleet to fulfill TargetSpotCapacity.
region	text		The AWS Region in which the resource is located.
resize_specifications	jsonb		The resize specification for the instance fleet.
sp_connection_name	text	=, !=, ~~, ~~, !~~, !~~	Steampipe connection name.
sp_ctx	jsonb		Steampipe context in JSON form.
state	text		The current state of the instance fleet.
state_change_reason	jsonb		Provides status change reason details for the instance fleet.
status_timeline	jsonb		Provides historical timestamps for the instance fleet, including the time of creation, the time it became ready to run jobs, and the time of termination.
target_on_demand_capacity	bigint		The target capacity of On-Demand units for the instance fleet, which determines how many On-Demand Instances to provision.
target_spot_capacity	bigint		The target capacity of Spot units for the instance fleet, which determines how many Spot Instances to provision.
title	text		Title of the resource.

Export

This table is available as a standalone Exporter CLI. Steampipe exporters are stand-alone binaries that allow you to extract data using Steampipe plugins without a database.

You can download the tarball for your platform from the Releases page, but it is simplest to install them with the steampipe_export_installer.sh script:

/bin/sh -c "$(curl -fsSL https://steampipe.io/install/export.sh)" -- aws

You can pass the configuration to the command with the --config argument:

steampipe_export_aws --config '<your_config>' aws_emr_instance_fleet