steampipe plugin install azure

Table: azure_data_lake_store - Query Azure Data Lake Store using SQL

Azure Data Lake Store is a hyper-scale repository for big data analytic workloads in Azure. It allows you to store and analyze petabyte-size files and trillions of objects. Azure Data Lake Store offers high-speed integration with Azure HDInsight, Azure Data Factory, and Azure Machine Learning.

Table Usage Guide

The azure_data_lake_store table provides insights into the data storage and analytics service in Azure. As a data engineer or data scientist, explore details about your Azure Data Lake Stores through this table, including their properties, encryption settings, and firewalls rules. Utilize it to manage and monitor your data lake stores, ensuring they are configured according to your organization's security and compliance policies.

Examples

Basic info

Explore the general information of your Azure Data Lake Store resources to understand their current state and type. This can help in monitoring the provisioning status and managing these resources effectively.

select
name,
id,
type,
provisioning_state
from
azure_data_lake_store;
select
name,
id,
type,
provisioning_state
from
azure_data_lake_store;

List data lake stores with encryption disabled

Explore which Azure data lake stores have disabled encryption, a potential security risk. This can be useful in auditing and improving your data security measures.

select
name,
id,
type,
provisioning_state
from
azure_data_lake_store
where
encryption_state = 'Disabled';
select
name,
id,
type,
provisioning_state
from
azure_data_lake_store
where
encryption_state = 'Disabled';

List data lake stores with firewall disabled

Discover the segments that utilize Azure Data Lake stores with disabled firewalls, enabling you to identify potential security risks and take necessary precautions. This is particularly useful for ensuring optimal security measures are in place and avoiding potential data breaches.

select
name,
id,
type,
provisioning_state
from
azure_data_lake_store
where
firewall_state = 'Disabled';
select
name,
id,
type,
provisioning_state
from
azure_data_lake_store
where
firewall_state = 'Disabled';

Schema for azure_data_lake_store

NameTypeOperatorsDescription
_ctxjsonbSteampipe context in JSON form.
account_idtextThe unique identifier associated with this data lake store account.
akasjsonbArray of globally unique identifier strings (also known as) for the resource.
cloud_environmenttextThe Azure Cloud Environment.
creation_timetimestamp with time zoneThe account creation time.
current_tiertextThe commitment tier in use for current month.
default_grouptextThe default owner group for all new folders and files created in the data lake store account.
diagnostic_settingsjsonbA list of active diagnostic settings for the data lake store.
encryption_configjsonbThe key vault encryption configuration.
encryption_provisioning_statetextThe current state of encryption provisioning for this data lake store account.
encryption_statetextThe current state of encryption for this data lake store account.
endpointtextThe full cname endpoint for this account.
firewall_allow_azure_ipsjsonbThe current state of allowing or disallowing IPs originating within azure through the firewall. If the firewall is disabled, this is not enforced.
firewall_rulesjsonbThe list of firewall rules associated with this data lake store account.
firewall_statetextThe current state of the IP address firewall for this data lake store account.
idtextThe resource identifier.
identityjsonbThe key vault encryption identity, if any.
last_modified_timetimestamp with time zoneThe account last modified time.
nametext=The resource name.
new_tiertextThe commitment tier to use for next month.
provisioning_statetextThe provisioning status of the data lake store account.
regiontextThe Azure region/location in which the resource is located.
resource_grouptext=The resource group which holds this resource.
sp_connection_nametext=, !=, ~~, ~~*, !~~, !~~*Steampipe connection name.
sp_ctxjsonbSteampipe context in JSON form.
statetextThe state of the data lake store account.
subscription_idtext=, !=, ~~, ~~*, !~~, !~~*The Azure Subscription ID in which the resource is located.
tagsjsonbA map of tags for the resource.
titletextTitle of the resource.
trusted_id_provider_statetextThe current state of the trusted identity provider feature for this data lake store account.
trusted_id_providersjsonbThe list of trusted identity providers associated with this data lake store account.
typetextThe resource type.
virtual_network_rulesjsonbThe list of virtual network rules associated with this data lake store account.

Export

This table is available as a standalone Exporter CLI. Steampipe exporters are stand-alone binaries that allow you to extract data using Steampipe plugins without a database.

You can download the tarball for your platform from the Releases page, but it is simplest to install them with the steampipe_export_installer.sh script:

/bin/sh -c "$(curl -fsSL https://steampipe.io/install/export.sh)" -- azure

You can pass the configuration to the command with the --config argument:

steampipe_export_azure --config '<your_config>' azure_data_lake_store