emr¶

This provider is a derived work of the Terraform Provider distributed under MPL 2.0. If you encounter a bug or missing feature, first check the pulumi/pulumi-alicloud repo; however, if that doesn’t turn up anything, please consult the source terraform-providers/terraform-provider-alicloud repo.

class pulumi_alicloud.emr.AwaitableGetDiskTypesResult(cluster_type=None, destination_resource=None, id=None, ids=None, instance_charge_type=None, instance_type=None, output_file=None, types=None, zone_id=None)¶

class pulumi_alicloud.emr.AwaitableGetInstanceTypesResult(cluster_type=None, destination_resource=None, id=None, ids=None, instance_charge_type=None, instance_type=None, output_file=None, support_local_storage=None, support_node_types=None, types=None, zone_id=None)¶

class pulumi_alicloud.emr.AwaitableGetMainVersionsResult(cluster_types=None, emr_version=None, id=None, ids=None, main_versions=None, output_file=None)¶

class pulumi_alicloud.emr.Cluster(resource_name, opts=None, bootstrap_actions=None, charge_type=None, cluster_type=None, deposit_type=None, eas_enable=None, emr_ver=None, high_availability_enable=None, host_groups=None, is_open_public_ip=None, key_pair_name=None, master_pwd=None, name=None, option_software_lists=None, related_cluster_id=None, security_group_id=None, ssh_enable=None, tags=None, use_local_metadb=None, user_defined_emr_ecs_role=None, vswitch_id=None, zone_id=None, __props__=None, __name__=None, __opts__=None)¶

Provides a EMR Cluster resource. With this you can create, read, and release EMR Cluster.

NOTE: Available in 1.57.0+.

Parameters

• resource_name (str) – The name of the resource.

• opts (pulumi.ResourceOptions) – Options for the resource.

• charge_type (pulumi.Input[str]) – Charge Type for this group of hosts: PostPaid or PrePaid. If this is not specified, charge type will follow global charge_type value.

• cluster_type (pulumi.Input[str]) – EMR Cluster Type, e.g. HADOOP, KAFKA, DRUID, GATEWAY etc. You can find all valid EMR cluster type in emr web console. Supported ‘GATEWAY’ available in 1.61.0+.

• deposit_type (pulumi.Input[str]) – Cluster deposit type, HALF_MANAGED or FULL_MANAGED.

• eas_enable (pulumi.Input[bool]) – High security cluster (true) or not. Default value is false.

• emr_ver (pulumi.Input[str]) – EMR Version, e.g. EMR-3.22.0. You can find the all valid EMR Version in emr web console.

• high_availability_enable (pulumi.Input[bool]) – High Available for HDFS and YARN. If this is set true, MASTER group must have two nodes.

• host_groups (pulumi.Input[list]) – Groups of Host, You can specify MASTER as a group, CORE as a group (just like the above example).

• key_pair_name (pulumi.Input[str]) – Ssh key pair.

• master_pwd (pulumi.Input[str]) – Master ssh password.

• name (pulumi.Input[str]) – bootstrap action name.

• option_software_lists (pulumi.Input[list]) – Optional software list.

• related_cluster_id (pulumi.Input[str]) – This specify the related cluster id, if this cluster is a Gateway.

• security_group_id (pulumi.Input[str]) – Security Group ID for Cluster, you can also specify this key for each host group.

• ssh_enable (pulumi.Input[bool]) – If this is set true, we can ssh into cluster. Default value is false.

• tags (pulumi.Input[dict]) – A mapping of tags to assign to the resource.

• use_local_metadb (pulumi.Input[bool]) – Use local metadb. Default is false.

• user_defined_emr_ecs_role (pulumi.Input[str]) – Alicloud EMR uses roles to perform actions on your behalf when provisioning cluster resources, running applications, dynamically scaling resources. EMR uses the following roles when interacting with other Alicloud services. Default value is AliyunEmrEcsDefaultRole.

• vswitch_id (pulumi.Input[str]) – Global vswitch id, you can also specify it in host group.

• zone_id (pulumi.Input[str]) – Zone ID, e.g. cn-huhehaote-a

The bootstrap_actions object supports the following:

• arg (pulumi.Input[str]) - bootstrap action args, e.g. “–a=b”.

• name (pulumi.Input[str]) - bootstrap action name.

• path (pulumi.Input[str]) - bootstrap action path, e.g. “oss://bucket/path”.

The host_groups object supports the following:

• auto_renew (pulumi.Input[bool]) - Auto renew for prepaid, true of false. Default is false.

• charge_type (pulumi.Input[str]) - Charge Type for this group of hosts: PostPaid or PrePaid. If this is not specified, charge type will follow global charge_type value.

• diskCapacity (pulumi.Input[str]) - Data disk capacity.

• diskCount (pulumi.Input[str]) - Data disk count.

• disk_type (pulumi.Input[str]) - Data disk type. Supported value: cloud,cloud_efficiency,cloud_ssd,local_disk,cloud_essd.

• gpuDriver (pulumi.Input[str])

• hostGroupName (pulumi.Input[str]) - host group name.

• hostGroupType (pulumi.Input[str]) - host group type, supported value: MASTER, CORE or TASK, supported ‘GATEWAY’ available in 1.61.0+.

• instanceList (pulumi.Input[str]) - Instance list for cluster scale down. This value follows the json format, e.g. [“instance_id1”,”instance_id2”]. escape character for ” is “.

• instance_type (pulumi.Input[str]) - Host Ecs instance type.

• node_count (pulumi.Input[str]) - Host number in this group.

• period (pulumi.Input[float]) - If charge type is PrePaid, this should be specified, unit is month. Supported value: 1、2、3、4、5、6、7、8、9、12、24、36.

• sysDiskCapacity (pulumi.Input[str]) - System disk capacity.

• sysDiskType (pulumi.Input[str]) - System disk type. Supported value: cloud,cloud_efficiency,cloud_ssd,cloud_essd.

charge_type: pulumi.Output[str] = None¶

Charge Type for this group of hosts: PostPaid or PrePaid. If this is not specified, charge type will follow global charge_type value.

cluster_type: pulumi.Output[str] = None¶

EMR Cluster Type, e.g. HADOOP, KAFKA, DRUID, GATEWAY etc. You can find all valid EMR cluster type in emr web console. Supported ‘GATEWAY’ available in 1.61.0+.

deposit_type: pulumi.Output[str] = None¶

Cluster deposit type, HALF_MANAGED or FULL_MANAGED.

eas_enable: pulumi.Output[bool] = None¶

High security cluster (true) or not. Default value is false.

emr_ver: pulumi.Output[str] = None¶

EMR Version, e.g. EMR-3.22.0. You can find the all valid EMR Version in emr web console.

high_availability_enable: pulumi.Output[bool] = None¶

High Available for HDFS and YARN. If this is set true, MASTER group must have two nodes.

host_groups: pulumi.Output[list] = None¶

Groups of Host, You can specify MASTER as a group, CORE as a group (just like the above example).

• auto_renew (bool) - Auto renew for prepaid, true of false. Default is false.

• charge_type (str) - Charge Type for this group of hosts: PostPaid or PrePaid. If this is not specified, charge type will follow global charge_type value.

• diskCapacity (str) - Data disk capacity.

• diskCount (str) - Data disk count.

• disk_type (str) - Data disk type. Supported value: cloud,cloud_efficiency,cloud_ssd,local_disk,cloud_essd.

• gpuDriver (str)

• hostGroupName (str) - host group name.

• hostGroupType (str) - host group type, supported value: MASTER, CORE or TASK, supported ‘GATEWAY’ available in 1.61.0+.

• instanceList (str) - Instance list for cluster scale down. This value follows the json format, e.g. [“instance_id1”,”instance_id2”]. escape character for ” is “.

• instance_type (str) - Host Ecs instance type.

• node_count (str) - Host number in this group.

• period (float) - If charge type is PrePaid, this should be specified, unit is month. Supported value: 1、2、3、4、5、6、7、8、9、12、24、36.

• sysDiskCapacity (str) - System disk capacity.

• sysDiskType (str) - System disk type. Supported value: cloud,cloud_efficiency,cloud_ssd,cloud_essd.

key_pair_name: pulumi.Output[str] = None¶

Ssh key pair.

master_pwd: pulumi.Output[str] = None¶

Master ssh password.

name: pulumi.Output[str] = None¶

bootstrap action name.

option_software_lists: pulumi.Output[list] = None¶

Optional software list.

related_cluster_id: pulumi.Output[str] = None¶

This specify the related cluster id, if this cluster is a Gateway.

security_group_id: pulumi.Output[str] = None¶

Security Group ID for Cluster, you can also specify this key for each host group.

ssh_enable: pulumi.Output[bool] = None¶

If this is set true, we can ssh into cluster. Default value is false.

tags: pulumi.Output[dict] = None¶

A mapping of tags to assign to the resource.

use_local_metadb: pulumi.Output[bool] = None¶

Use local metadb. Default is false.

user_defined_emr_ecs_role: pulumi.Output[str] = None¶

Alicloud EMR uses roles to perform actions on your behalf when provisioning cluster resources, running applications, dynamically scaling resources. EMR uses the following roles when interacting with other Alicloud services. Default value is AliyunEmrEcsDefaultRole.

vswitch_id: pulumi.Output[str] = None¶

Global vswitch id, you can also specify it in host group.

zone_id: pulumi.Output[str] = None¶

Zone ID, e.g. cn-huhehaote-a

static get(resource_name, id, opts=None, bootstrap_actions=None, charge_type=None, cluster_type=None, deposit_type=None, eas_enable=None, emr_ver=None, high_availability_enable=None, host_groups=None, is_open_public_ip=None, key_pair_name=None, master_pwd=None, name=None, option_software_lists=None, related_cluster_id=None, security_group_id=None, ssh_enable=None, tags=None, use_local_metadb=None, user_defined_emr_ecs_role=None, vswitch_id=None, zone_id=None)¶

Get an existing Cluster resource’s state with the given name, id, and optional extra properties used to qualify the lookup.

Parameters

• resource_name (str) – The unique name of the resulting resource.

• id (str) – The unique provider ID of the resource to lookup.

• opts (pulumi.ResourceOptions) – Options for the resource.

• charge_type (pulumi.Input[str]) – Charge Type for this group of hosts: PostPaid or PrePaid. If this is not specified, charge type will follow global charge_type value.

• cluster_type (pulumi.Input[str]) – EMR Cluster Type, e.g. HADOOP, KAFKA, DRUID, GATEWAY etc. You can find all valid EMR cluster type in emr web console. Supported ‘GATEWAY’ available in 1.61.0+.

• deposit_type (pulumi.Input[str]) – Cluster deposit type, HALF_MANAGED or FULL_MANAGED.

• eas_enable (pulumi.Input[bool]) – High security cluster (true) or not. Default value is false.

• emr_ver (pulumi.Input[str]) – EMR Version, e.g. EMR-3.22.0. You can find the all valid EMR Version in emr web console.

• high_availability_enable (pulumi.Input[bool]) – High Available for HDFS and YARN. If this is set true, MASTER group must have two nodes.

• host_groups (pulumi.Input[list]) – Groups of Host, You can specify MASTER as a group, CORE as a group (just like the above example).

• key_pair_name (pulumi.Input[str]) – Ssh key pair.

• master_pwd (pulumi.Input[str]) – Master ssh password.

• name (pulumi.Input[str]) – bootstrap action name.

• option_software_lists (pulumi.Input[list]) – Optional software list.

• related_cluster_id (pulumi.Input[str]) – This specify the related cluster id, if this cluster is a Gateway.

• security_group_id (pulumi.Input[str]) – Security Group ID for Cluster, you can also specify this key for each host group.

• ssh_enable (pulumi.Input[bool]) – If this is set true, we can ssh into cluster. Default value is false.

• tags (pulumi.Input[dict]) – A mapping of tags to assign to the resource.

• use_local_metadb (pulumi.Input[bool]) – Use local metadb. Default is false.

• user_defined_emr_ecs_role (pulumi.Input[str]) – Alicloud EMR uses roles to perform actions on your behalf when provisioning cluster resources, running applications, dynamically scaling resources. EMR uses the following roles when interacting with other Alicloud services. Default value is AliyunEmrEcsDefaultRole.

• vswitch_id (pulumi.Input[str]) – Global vswitch id, you can also specify it in host group.

• zone_id (pulumi.Input[str]) – Zone ID, e.g. cn-huhehaote-a

The bootstrap_actions object supports the following:

• arg (pulumi.Input[str]) - bootstrap action args, e.g. “–a=b”.

• name (pulumi.Input[str]) - bootstrap action name.

• path (pulumi.Input[str]) - bootstrap action path, e.g. “oss://bucket/path”.

The host_groups object supports the following:

• auto_renew (pulumi.Input[bool]) - Auto renew for prepaid, true of false. Default is false.

• charge_type (pulumi.Input[str]) - Charge Type for this group of hosts: PostPaid or PrePaid. If this is not specified, charge type will follow global charge_type value.

• diskCapacity (pulumi.Input[str]) - Data disk capacity.

• diskCount (pulumi.Input[str]) - Data disk count.

• disk_type (pulumi.Input[str]) - Data disk type. Supported value: cloud,cloud_efficiency,cloud_ssd,local_disk,cloud_essd.

• gpuDriver (pulumi.Input[str])

• hostGroupName (pulumi.Input[str]) - host group name.

• hostGroupType (pulumi.Input[str]) - host group type, supported value: MASTER, CORE or TASK, supported ‘GATEWAY’ available in 1.61.0+.

• instanceList (pulumi.Input[str]) - Instance list for cluster scale down. This value follows the json format, e.g. [“instance_id1”,”instance_id2”]. escape character for ” is “.

• instance_type (pulumi.Input[str]) - Host Ecs instance type.

• node_count (pulumi.Input[str]) - Host number in this group.

• period (pulumi.Input[float]) - If charge type is PrePaid, this should be specified, unit is month. Supported value: 1、2、3、4、5、6、7、8、9、12、24、36.

• sysDiskCapacity (pulumi.Input[str]) - System disk capacity.

• sysDiskType (pulumi.Input[str]) - System disk type. Supported value: cloud,cloud_efficiency,cloud_ssd,cloud_essd.

translate_output_property(prop)¶

Provides subclasses of Resource an opportunity to translate names of output properties into a format of their choosing before writing those properties to the resource object.

Parameters

prop (str) – A property name.

Returns

A potentially transformed property name.

Return type

str

translate_input_property(prop)¶

Provides subclasses of Resource an opportunity to translate names of input properties into a format of their choosing before sending those properties to the Pulumi engine.

Parameters

prop (str) – A property name.

Returns

A potentially transformed property name.

Return type

str

class pulumi_alicloud.emr.GetDiskTypesResult(cluster_type=None, destination_resource=None, id=None, ids=None, instance_charge_type=None, instance_type=None, output_file=None, types=None, zone_id=None)¶

A collection of values returned by getDiskTypes.

id = None¶

The provider-assigned unique ID for this managed resource.

ids = None¶

A list of data disk and system disk type IDs.

types = None¶

A list of emr instance types. Each element contains the following attributes:

class pulumi_alicloud.emr.GetInstanceTypesResult(cluster_type=None, destination_resource=None, id=None, ids=None, instance_charge_type=None, instance_type=None, output_file=None, support_local_storage=None, support_node_types=None, types=None, zone_id=None)¶

A collection of values returned by getInstanceTypes.

id = None¶

The provider-assigned unique ID for this managed resource.

ids = None¶

A list of emr instance types IDs.

types = None¶

A list of emr instance types. Each element contains the following attributes:

zone_id = None¶

The available zone id in Alibaba Cloud account

class pulumi_alicloud.emr.GetMainVersionsResult(cluster_types=None, emr_version=None, id=None, ids=None, main_versions=None, output_file=None)¶

A collection of values returned by getMainVersions.

emr_version = None¶

The version of the emr cluster instance.

id = None¶

The provider-assigned unique ID for this managed resource.

ids = None¶

A list of emr instance types IDs.

main_versions = None¶

A list of versions of the emr cluster instance. Each element contains the following attributes:

pulumi_alicloud.emr.get_disk_types(cluster_type=None, destination_resource=None, instance_charge_type=None, instance_type=None, output_file=None, zone_id=None, opts=None)¶

The emr.getDiskTypes data source provides a collection of data disk and system disk types available in Alibaba Cloud account when create a emr cluster.

NOTE: Available in 1.60.0+

import pulumi
import pulumi_alicloud as alicloud

default = alicloud.emr.get_disk_types(cluster_type="HADOOP",
    destination_resource="DataDisk",
    instance_charge_type="PostPaid",
    instance_type="ecs.g5.xlarge",
    zone_id="cn-huhehaote-a")
pulumi.export("dataDiskType", default.types[0]["value"])

Parameters

• cluster_type (str) – The cluster type of the emr cluster instance. Possible values: HADOOP, KAFKA, ZOOKEEPER, DRUID.

• destination_resource (str) – The destination resource of emr cluster instance

• instance_charge_type (str) – Filter the results by charge type. Valid values: PrePaid and PostPaid. Default to PostPaid.

• instance_type (str) – The ecs instance type of create emr cluster instance.

• zone_id (str) – The Zone to create emr cluster instance.

pulumi_alicloud.emr.get_instance_types(cluster_type=None, destination_resource=None, instance_charge_type=None, instance_type=None, output_file=None, support_local_storage=None, support_node_types=None, zone_id=None, opts=None)¶

The emr.getInstanceTypes data source provides a collection of ecs instance types available in Alibaba Cloud account when create a emr cluster.

NOTE: Available in 1.59.0+

import pulumi
import pulumi_alicloud as alicloud

default = alicloud.emr.get_instance_types(cluster_type="HADOOP",
    destination_resource="InstanceType",
    instance_charge_type="PostPaid",
    instance_type="ecs.g5.2xlarge",
    support_local_storage=False,
    support_node_types=[
        "MASTER",
        "CORE",
    ])
pulumi.export("firstInstanceType", default.types[0]["id"])

Parameters

• cluster_type (str) – The cluster type of the emr cluster instance. Possible values: HADOOP, KAFKA, ZOOKEEPER, DRUID.

• destination_resource (str) – The destination resource of emr cluster instance

• instance_charge_type (str) – Filter the results by charge type. Valid values: PrePaid and PostPaid. Default to PostPaid.

• instance_type (str) – Filter the specific ecs instance type to create emr cluster.

• support_local_storage (bool) – Whether the current storage disk is local or not.

• support_node_types (list) – The specific supported node type list. Possible values may be any one or combination of these: [“MASTER”, “CORE”, “TASK”, “GATEWAY”]

• zone_id (str) – The supported resources of specific zoneId.

pulumi_alicloud.emr.get_main_versions(cluster_types=None, emr_version=None, output_file=None, opts=None)¶

The emr.getMainVersions data source provides a collection of emr main versions available in Alibaba Cloud account when create a emr cluster.

NOTE: Available in 1.59.0+

import pulumi
import pulumi_alicloud as alicloud

default = alicloud.emr.get_main_versions(cluster_types=[
        "HADOOP",
        "ZOOKEEPER",
    ],
    emr_version="EMR-3.22.0")
pulumi.export("firstMainVersion", default.main_versions[0]["emrVersion"])
pulumi.export("thisClusterTypes", default.main_versions[0]["clusterTypes"])

Parameters

• cluster_types (list) – The supported clusterType of this emr version. Possible values may be any one or combination of these: [“HADOOP”, “DRUID”, “KAFKA”, “ZOOKEEPER”, “FLINK”, “CLICKHOUSE”]

• emr_version (str) – The version of the emr cluster instance. Possible values: EMR-4.0.0, EMR-3.23.0, EMR-3.22.0.