Cluster

Manages a Cloud Dataproc cluster resource within GCP. For more information see the official dataproc documentation.

!> Warning: Due to limitations of the API, all arguments except labels,cluster_config.worker_config.num_instances and cluster_config.preemptible_worker_config.num_instances are non-updatable. Changing others will cause recreation of the whole cluster!

Create a Cluster Resource

new Cluster(name: string, args?: ClusterArgs, opts?: CustomResourceOptions);

def Cluster(resource_name, opts=None, cluster_config=None, labels=None, name=None, project=None, region=None, __props__=None);

func NewCluster(ctx *Context, name string, args *ClusterArgs, opts ...ResourceOption) (*Cluster, error)

public Cluster(string name, ClusterArgs? args = null, CustomResourceOptions? opts = null)

name string: The unique name of the resource.
args ClusterArgs: The arguments to resource properties.
opts CustomResourceOptions: Bag of options to control resource's behavior.

resource_name str: The unique name of the resource.
opts ResourceOptions: A bag of options that control this resource's behavior.

ctx Context: Context object for the current deployment.
name string: The unique name of the resource.
args ClusterArgs: The arguments to resource properties.
opts ResourceOption: Bag of options to control resource's behavior.

name string: The unique name of the resource.
args ClusterArgs: The arguments to resource properties.
opts CustomResourceOptions: Bag of options to control resource's behavior.

Cluster Resource Properties

To learn more about resource properties and how to use them, see Inputs and Outputs in the Programming Model docs.

Inputs

The Cluster resource accepts the following input properties:

ClusterConfig ClusterClusterConfigArgs: Allows you to configure various aspects of the cluster. Structure defined below.
Labels Dictionary<string, string>: The list of labels (key/value pairs) to be applied to instances in the cluster. GCP generates some itself including goog-dataproc-cluster-name which is the name of the cluster.
Name string: The name of the cluster, unique within the project and zone.
Project string: The ID of the project in which the cluster will exist. If it is not provided, the provider project is used.
Region string: The region in which the cluster and associated nodes will be created in. Defaults to global.

ClusterConfig ClusterClusterConfig: Allows you to configure various aspects of the cluster. Structure defined below.
Labels map[string]string: The list of labels (key/value pairs) to be applied to instances in the cluster. GCP generates some itself including goog-dataproc-cluster-name which is the name of the cluster.
Name string: The name of the cluster, unique within the project and zone.
Project string: The ID of the project in which the cluster will exist. If it is not provided, the provider project is used.
Region string: The region in which the cluster and associated nodes will be created in. Defaults to global.

clusterConfig ClusterClusterConfig: Allows you to configure various aspects of the cluster. Structure defined below.
labels {[key: string]: string}: The list of labels (key/value pairs) to be applied to instances in the cluster. GCP generates some itself including goog-dataproc-cluster-name which is the name of the cluster.
name string: The name of the cluster, unique within the project and zone.
project string: The ID of the project in which the cluster will exist. If it is not provided, the provider project is used.
region string: The region in which the cluster and associated nodes will be created in. Defaults to global.

cluster_config Dict[ClusterClusterConfig]: Allows you to configure various aspects of the cluster. Structure defined below.
labels Dict[str, str]: The list of labels (key/value pairs) to be applied to instances in the cluster. GCP generates some itself including goog-dataproc-cluster-name which is the name of the cluster.
name str: The name of the cluster, unique within the project and zone.
project str: The ID of the project in which the cluster will exist. If it is not provided, the provider project is used.
region str: The region in which the cluster and associated nodes will be created in. Defaults to global.

Outputs

All input properties are implicitly available as output properties. Additionally, the Cluster resource produces the following output properties:

Id string: The provider-assigned unique ID for this managed resource.

Id string: The provider-assigned unique ID for this managed resource.

id string: The provider-assigned unique ID for this managed resource.

id str: The provider-assigned unique ID for this managed resource.

Look up an Existing Cluster Resource

Get an existing Cluster resource’s state with the given name, ID, and optional extra properties used to qualify the lookup.

public static get(name: string, id: Input<ID>, state?: ClusterState, opts?: CustomResourceOptions): Cluster

static get(resource_name, id, opts=None, cluster_config=None, labels=None, name=None, project=None, region=None, __props__=None);

func GetCluster(ctx *Context, name string, id IDInput, state *ClusterState, opts ...ResourceOption) (*Cluster, error)

public static Cluster Get(string name, Input<string> id, ClusterState? state, CustomResourceOptions? opts = null)

name: The unique name of the resulting resource.
id: The unique provider ID of the resource to lookup.
state: Any extra arguments used during the lookup.
opts: A bag of options that control this resource's behavior.

resource_name: The unique name of the resulting resource.
id: The unique provider ID of the resource to lookup.

name: The unique name of the resulting resource.
id: The unique provider ID of the resource to lookup.
state: Any extra arguments used during the lookup.
opts: A bag of options that control this resource's behavior.

name: The unique name of the resulting resource.
id: The unique provider ID of the resource to lookup.
state: Any extra arguments used during the lookup.
opts: A bag of options that control this resource's behavior.

The following state arguments are supported:

ClusterConfig ClusterClusterConfigArgs: Allows you to configure various aspects of the cluster. Structure defined below.
Labels Dictionary<string, string>: The list of labels (key/value pairs) to be applied to instances in the cluster. GCP generates some itself including goog-dataproc-cluster-name which is the name of the cluster.
Name string: The name of the cluster, unique within the project and zone.
Project string: The ID of the project in which the cluster will exist. If it is not provided, the provider project is used.
Region string: The region in which the cluster and associated nodes will be created in. Defaults to global.

ClusterConfig ClusterClusterConfig: Allows you to configure various aspects of the cluster. Structure defined below.
Labels map[string]string: The list of labels (key/value pairs) to be applied to instances in the cluster. GCP generates some itself including goog-dataproc-cluster-name which is the name of the cluster.
Name string: The name of the cluster, unique within the project and zone.
Project string: The ID of the project in which the cluster will exist. If it is not provided, the provider project is used.
Region string: The region in which the cluster and associated nodes will be created in. Defaults to global.

clusterConfig ClusterClusterConfig: Allows you to configure various aspects of the cluster. Structure defined below.
labels {[key: string]: string}: The list of labels (key/value pairs) to be applied to instances in the cluster. GCP generates some itself including goog-dataproc-cluster-name which is the name of the cluster.
name string: The name of the cluster, unique within the project and zone.
project string: The ID of the project in which the cluster will exist. If it is not provided, the provider project is used.
region string: The region in which the cluster and associated nodes will be created in. Defaults to global.

cluster_config Dict[ClusterClusterConfig]: Allows you to configure various aspects of the cluster. Structure defined below.
labels Dict[str, str]: The list of labels (key/value pairs) to be applied to instances in the cluster. GCP generates some itself including goog-dataproc-cluster-name which is the name of the cluster.
name str: The name of the cluster, unique within the project and zone.
project str: The ID of the project in which the cluster will exist. If it is not provided, the provider project is used.
region str: The region in which the cluster and associated nodes will be created in. Defaults to global.

Supporting Types

ClusterClusterConfig

AutoscalingConfig ClusterClusterConfigAutoscalingConfigArgs: The autoscaling policy config associated with the cluster. Structure defined below.
Bucket string
EncryptionConfig ClusterClusterConfigEncryptionConfigArgs: The Customer managed encryption keys settings for the cluster. Structure defined below.
EndpointConfig ClusterClusterConfigEndpointConfigArgs: The config settings for port access on the cluster. Structure defined below.
GceClusterConfig ClusterClusterConfigGceClusterConfigArgs: Common config settings for resources of Google Compute Engine cluster instances, applicable to all instances in the cluster. Structure defined below.
InitializationActions List<ClusterClusterConfigInitializationActionArgs>: Commands to execute on each node after config is completed. You can specify multiple versions of these. Structure defined below.
LifecycleConfig ClusterClusterConfigLifecycleConfigArgs: The settings for auto deletion cluster schedule. Structure defined below.
MasterConfig ClusterClusterConfigMasterConfigArgs: The Google Compute Engine config settings for the master instances in a cluster.. Structure defined below.
PreemptibleWorkerConfig ClusterClusterConfigPreemptibleWorkerConfigArgs: The Google Compute Engine config settings for the additional (aka preemptible) instances in a cluster. Structure defined below.
SecurityConfig ClusterClusterConfigSecurityConfigArgs: Security related configuration. Structure defined below.
SoftwareConfig ClusterClusterConfigSoftwareConfigArgs: The config settings for software inside the cluster. Structure defined below.
StagingBucket string: The Cloud Storage staging bucket used to stage files, such as Hadoop jars, between client machines and the cluster. Note: If you don’t explicitly specify a staging_bucket then GCP will auto create / assign one for you. However, you are not guaranteed an auto generated bucket which is solely dedicated to your cluster; it may be shared with other clusters in the same region/zone also choosing to use the auto generation option.
WorkerConfig ClusterClusterConfigWorkerConfigArgs: The Google Compute Engine config settings for the worker instances in a cluster.. Structure defined below.

AutoscalingConfig ClusterClusterConfigAutoscalingConfig: The autoscaling policy config associated with the cluster. Structure defined below.
Bucket string
EncryptionConfig ClusterClusterConfigEncryptionConfig: The Customer managed encryption keys settings for the cluster. Structure defined below.
EndpointConfig ClusterClusterConfigEndpointConfig: The config settings for port access on the cluster. Structure defined below.
GceClusterConfig ClusterClusterConfigGceClusterConfig: Common config settings for resources of Google Compute Engine cluster instances, applicable to all instances in the cluster. Structure defined below.
InitializationActions []ClusterClusterConfigInitializationAction: Commands to execute on each node after config is completed. You can specify multiple versions of these. Structure defined below.
LifecycleConfig ClusterClusterConfigLifecycleConfig: The settings for auto deletion cluster schedule. Structure defined below.
MasterConfig ClusterClusterConfigMasterConfig: The Google Compute Engine config settings for the master instances in a cluster.. Structure defined below.
PreemptibleWorkerConfig ClusterClusterConfigPreemptibleWorkerConfig: The Google Compute Engine config settings for the additional (aka preemptible) instances in a cluster. Structure defined below.
SecurityConfig ClusterClusterConfigSecurityConfig: Security related configuration. Structure defined below.
SoftwareConfig ClusterClusterConfigSoftwareConfig: The config settings for software inside the cluster. Structure defined below.
StagingBucket string: The Cloud Storage staging bucket used to stage files, such as Hadoop jars, between client machines and the cluster. Note: If you don’t explicitly specify a staging_bucket then GCP will auto create / assign one for you. However, you are not guaranteed an auto generated bucket which is solely dedicated to your cluster; it may be shared with other clusters in the same region/zone also choosing to use the auto generation option.
WorkerConfig ClusterClusterConfigWorkerConfig: The Google Compute Engine config settings for the worker instances in a cluster.. Structure defined below.

autoscalingConfig ClusterClusterConfigAutoscalingConfig: The autoscaling policy config associated with the cluster. Structure defined below.
bucket string
encryptionConfig ClusterClusterConfigEncryptionConfig: The Customer managed encryption keys settings for the cluster. Structure defined below.
endpointConfig ClusterClusterConfigEndpointConfig: The config settings for port access on the cluster. Structure defined below.
gceClusterConfig ClusterClusterConfigGceClusterConfig: Common config settings for resources of Google Compute Engine cluster instances, applicable to all instances in the cluster. Structure defined below.
initializationActions ClusterClusterConfigInitializationAction[]: Commands to execute on each node after config is completed. You can specify multiple versions of these. Structure defined below.
lifecycleConfig ClusterClusterConfigLifecycleConfig: The settings for auto deletion cluster schedule. Structure defined below.
masterConfig ClusterClusterConfigMasterConfig: The Google Compute Engine config settings for the master instances in a cluster.. Structure defined below.
preemptibleWorkerConfig ClusterClusterConfigPreemptibleWorkerConfig: The Google Compute Engine config settings for the additional (aka preemptible) instances in a cluster. Structure defined below.
securityConfig ClusterClusterConfigSecurityConfig: Security related configuration. Structure defined below.
softwareConfig ClusterClusterConfigSoftwareConfig: The config settings for software inside the cluster. Structure defined below.
stagingBucket string: The Cloud Storage staging bucket used to stage files, such as Hadoop jars, between client machines and the cluster. Note: If you don’t explicitly specify a staging_bucket then GCP will auto create / assign one for you. However, you are not guaranteed an auto generated bucket which is solely dedicated to your cluster; it may be shared with other clusters in the same region/zone also choosing to use the auto generation option.
workerConfig ClusterClusterConfigWorkerConfig: The Google Compute Engine config settings for the worker instances in a cluster.. Structure defined below.

autoscalingConfig Dict[ClusterClusterConfigAutoscalingConfig]: The autoscaling policy config associated with the cluster. Structure defined below.
bucket str
encryptionConfig Dict[ClusterClusterConfigEncryptionConfig]: The Customer managed encryption keys settings for the cluster. Structure defined below.
endpointConfig Dict[ClusterClusterConfigEndpointConfig]: The config settings for port access on the cluster. Structure defined below.
gceClusterConfig Dict[ClusterClusterConfigGceClusterConfig]: Common config settings for resources of Google Compute Engine cluster instances, applicable to all instances in the cluster. Structure defined below.
initializationActions List[ClusterClusterConfigInitializationAction]: Commands to execute on each node after config is completed. You can specify multiple versions of these. Structure defined below.
lifecycleConfig Dict[ClusterClusterConfigLifecycleConfig]: The settings for auto deletion cluster schedule. Structure defined below.
masterConfig Dict[ClusterClusterConfigMasterConfig]: The Google Compute Engine config settings for the master instances in a cluster.. Structure defined below.
preemptibleWorkerConfig Dict[ClusterClusterConfigPreemptibleWorkerConfig]: The Google Compute Engine config settings for the additional (aka preemptible) instances in a cluster. Structure defined below.
securityConfig Dict[ClusterClusterConfigSecurityConfig]: Security related configuration. Structure defined below.
softwareConfig Dict[ClusterClusterConfigSoftwareConfig]: The config settings for software inside the cluster. Structure defined below.
stagingBucket str: The Cloud Storage staging bucket used to stage files, such as Hadoop jars, between client machines and the cluster. Note: If you don’t explicitly specify a staging_bucket then GCP will auto create / assign one for you. However, you are not guaranteed an auto generated bucket which is solely dedicated to your cluster; it may be shared with other clusters in the same region/zone also choosing to use the auto generation option.
worker_config Dict[ClusterClusterConfigWorkerConfig]: The Google Compute Engine config settings for the worker instances in a cluster.. Structure defined below.

ClusterClusterConfigAutoscalingConfig

PolicyUri string: The autoscaling policy used by the cluster.

PolicyUri string: The autoscaling policy used by the cluster.

policyUri string: The autoscaling policy used by the cluster.

policyUri str: The autoscaling policy used by the cluster.

ClusterClusterConfigEncryptionConfig

KmsKeyName string: The Cloud KMS key name to use for PD disk encryption for all instances in the cluster.

KmsKeyName string: The Cloud KMS key name to use for PD disk encryption for all instances in the cluster.

kmsKeyName string: The Cloud KMS key name to use for PD disk encryption for all instances in the cluster.

kms_key_name str: The Cloud KMS key name to use for PD disk encryption for all instances in the cluster.

ClusterClusterConfigEndpointConfig

EnableHttpPortAccess bool: The flag to enable http access to specific ports on the cluster from external sources (aka Component Gateway). Defaults to false.
HttpPorts Dictionary<string, object>

EnableHttpPortAccess bool: The flag to enable http access to specific ports on the cluster from external sources (aka Component Gateway). Defaults to false.
HttpPorts map[string]interface{}

enableHttpPortAccess boolean: The flag to enable http access to specific ports on the cluster from external sources (aka Component Gateway). Defaults to false.
httpPorts {[key: string]: any}

enableHttpPortAccess bool: The flag to enable http access to specific ports on the cluster from external sources (aka Component Gateway). Defaults to false.
httpPorts Dict[str, Any]

ClusterClusterConfigGceClusterConfig

InternalIpOnly bool: By default, clusters are not restricted to internal IP addresses, and will have ephemeral external IP addresses assigned to each instance. If set to true, all instances in the cluster will only have internal IP addresses. Note: Private Google Access (also known as privateIpGoogleAccess) must be enabled on the subnetwork that the cluster will be launched in.
Metadata Dictionary<string, string>: A map of the Compute Engine metadata entries to add to all instances (see Project and instance metadata).
Network string: The name or self_link of the Google Compute Engine network to the cluster will be part of. Conflicts with subnetwork. If neither is specified, this defaults to the “default” network.
ServiceAccount string: The service account to be used by the Node VMs. If not specified, the “default” service account is used.
ServiceAccountScopes List<string>: The set of Google API scopes to be made available on all of the node VMs under the service_account specified. These can be either FQDNs, or scope aliases. The following scopes must be set if any other scopes are set. They’re necessary to ensure the correct functioning ofthe cluster, and are set automatically by the API:
Subnetwork string: The name or self_link of the Google Compute Engine subnetwork the cluster will be part of. Conflicts with network.
Tags List<string>: The list of instance tags applied to instances in the cluster. Tags are used to identify valid sources or targets for network firewalls.
Zone string: The GCP zone where your data is stored and used (i.e. where the master and the worker nodes will be created in). If region is set to ‘global’ (default) then zone is mandatory, otherwise GCP is able to make use of Auto Zone Placement to determine this automatically for you. Note: This setting additionally determines and restricts which computing resources are available for use with other configs such as cluster_config.master_config.machine_type and cluster_config.worker_config.machine_type.

InternalIpOnly bool: By default, clusters are not restricted to internal IP addresses, and will have ephemeral external IP addresses assigned to each instance. If set to true, all instances in the cluster will only have internal IP addresses. Note: Private Google Access (also known as privateIpGoogleAccess) must be enabled on the subnetwork that the cluster will be launched in.
Metadata map[string]string: A map of the Compute Engine metadata entries to add to all instances (see Project and instance metadata).
Network string: The name or self_link of the Google Compute Engine network to the cluster will be part of. Conflicts with subnetwork. If neither is specified, this defaults to the “default” network.
ServiceAccount string: The service account to be used by the Node VMs. If not specified, the “default” service account is used.
ServiceAccountScopes []string: The set of Google API scopes to be made available on all of the node VMs under the service_account specified. These can be either FQDNs, or scope aliases. The following scopes must be set if any other scopes are set. They’re necessary to ensure the correct functioning ofthe cluster, and are set automatically by the API:
Subnetwork string: The name or self_link of the Google Compute Engine subnetwork the cluster will be part of. Conflicts with network.
Tags []string: The list of instance tags applied to instances in the cluster. Tags are used to identify valid sources or targets for network firewalls.
Zone string: The GCP zone where your data is stored and used (i.e. where the master and the worker nodes will be created in). If region is set to ‘global’ (default) then zone is mandatory, otherwise GCP is able to make use of Auto Zone Placement to determine this automatically for you. Note: This setting additionally determines and restricts which computing resources are available for use with other configs such as cluster_config.master_config.machine_type and cluster_config.worker_config.machine_type.

internalIpOnly boolean: By default, clusters are not restricted to internal IP addresses, and will have ephemeral external IP addresses assigned to each instance. If set to true, all instances in the cluster will only have internal IP addresses. Note: Private Google Access (also known as privateIpGoogleAccess) must be enabled on the subnetwork that the cluster will be launched in.
metadata {[key: string]: string}: A map of the Compute Engine metadata entries to add to all instances (see Project and instance metadata).
network string: The name or self_link of the Google Compute Engine network to the cluster will be part of. Conflicts with subnetwork. If neither is specified, this defaults to the “default” network.
serviceAccount string: The service account to be used by the Node VMs. If not specified, the “default” service account is used.
serviceAccountScopes string[]: The set of Google API scopes to be made available on all of the node VMs under the service_account specified. These can be either FQDNs, or scope aliases. The following scopes must be set if any other scopes are set. They’re necessary to ensure the correct functioning ofthe cluster, and are set automatically by the API:
subnetwork string: The name or self_link of the Google Compute Engine subnetwork the cluster will be part of. Conflicts with network.
tags string[]: The list of instance tags applied to instances in the cluster. Tags are used to identify valid sources or targets for network firewalls.
zone string: The GCP zone where your data is stored and used (i.e. where the master and the worker nodes will be created in). If region is set to ‘global’ (default) then zone is mandatory, otherwise GCP is able to make use of Auto Zone Placement to determine this automatically for you. Note: This setting additionally determines and restricts which computing resources are available for use with other configs such as cluster_config.master_config.machine_type and cluster_config.worker_config.machine_type.

internalIpOnly bool: By default, clusters are not restricted to internal IP addresses, and will have ephemeral external IP addresses assigned to each instance. If set to true, all instances in the cluster will only have internal IP addresses. Note: Private Google Access (also known as privateIpGoogleAccess) must be enabled on the subnetwork that the cluster will be launched in.
metadata Dict[str, str]: A map of the Compute Engine metadata entries to add to all instances (see Project and instance metadata).
network str: The name or self_link of the Google Compute Engine network to the cluster will be part of. Conflicts with subnetwork. If neither is specified, this defaults to the “default” network.
serviceAccountScopes List[str]: The set of Google API scopes to be made available on all of the node VMs under the service_account specified. These can be either FQDNs, or scope aliases. The following scopes must be set if any other scopes are set. They’re necessary to ensure the correct functioning ofthe cluster, and are set automatically by the API:
service_account str: The service account to be used by the Node VMs. If not specified, the “default” service account is used.
subnetwork str: The name or self_link of the Google Compute Engine subnetwork the cluster will be part of. Conflicts with network.
tags List[str]: The list of instance tags applied to instances in the cluster. Tags are used to identify valid sources or targets for network firewalls.
zone str: The GCP zone where your data is stored and used (i.e. where the master and the worker nodes will be created in). If region is set to ‘global’ (default) then zone is mandatory, otherwise GCP is able to make use of Auto Zone Placement to determine this automatically for you. Note: This setting additionally determines and restricts which computing resources are available for use with other configs such as cluster_config.master_config.machine_type and cluster_config.worker_config.machine_type.

ClusterClusterConfigInitializationAction

Script string: The script to be executed during initialization of the cluster. The script must be a GCS file with a gs:// prefix.
TimeoutSec int: The maximum duration (in seconds) which script is allowed to take to execute its action. GCP will default to a predetermined computed value if not set (currently 300).

Script string: The script to be executed during initialization of the cluster. The script must be a GCS file with a gs:// prefix.
TimeoutSec int: The maximum duration (in seconds) which script is allowed to take to execute its action. GCP will default to a predetermined computed value if not set (currently 300).

script string: The script to be executed during initialization of the cluster. The script must be a GCS file with a gs:// prefix.
timeoutSec number: The maximum duration (in seconds) which script is allowed to take to execute its action. GCP will default to a predetermined computed value if not set (currently 300).

script str: The script to be executed during initialization of the cluster. The script must be a GCS file with a gs:// prefix.
timeout_sec float: The maximum duration (in seconds) which script is allowed to take to execute its action. GCP will default to a predetermined computed value if not set (currently 300).

ClusterClusterConfigLifecycleConfig

AutoDeleteTime string: The time when cluster will be auto-deleted. A timestamp in RFC3339 UTC “Zulu” format, accurate to nanoseconds. Example: “2014-10-02T15:01:23.045123456Z”.
IdleDeleteTtl string: The duration to keep the cluster alive while idling (no jobs running). After this TTL, the cluster will be deleted. Valid range: [10m, 14d].
IdleStartTime string

AutoDeleteTime string: The time when cluster will be auto-deleted. A timestamp in RFC3339 UTC “Zulu” format, accurate to nanoseconds. Example: “2014-10-02T15:01:23.045123456Z”.
IdleDeleteTtl string: The duration to keep the cluster alive while idling (no jobs running). After this TTL, the cluster will be deleted. Valid range: [10m, 14d].
IdleStartTime string

autoDeleteTime string: The time when cluster will be auto-deleted. A timestamp in RFC3339 UTC “Zulu” format, accurate to nanoseconds. Example: “2014-10-02T15:01:23.045123456Z”.
idleDeleteTtl string: The duration to keep the cluster alive while idling (no jobs running). After this TTL, the cluster will be deleted. Valid range: [10m, 14d].
idleStartTime string

autoDeleteTime str: The time when cluster will be auto-deleted. A timestamp in RFC3339 UTC “Zulu” format, accurate to nanoseconds. Example: “2014-10-02T15:01:23.045123456Z”.
idleDeleteTtl str: The duration to keep the cluster alive while idling (no jobs running). After this TTL, the cluster will be deleted. Valid range: [10m, 14d].
idleStartTime str

ClusterClusterConfigMasterConfig

Accelerators List<ClusterClusterConfigMasterConfigAcceleratorArgs>: The Compute Engine accelerator configuration for these instances. Can be specified multiple times.
DiskConfig ClusterClusterConfigMasterConfigDiskConfigArgs: Disk Config
ImageUri string: The URI for the image to use for this worker. See the guide for more information.
InstanceNames List<string>
MachineType string: The name of a Google Compute Engine machine type to create for the worker nodes. If not specified, GCP will default to a predetermined computed value (currently n1-standard-4).
MinCpuPlatform string: The name of a minimum generation of CPU family for the master. If not specified, GCP will default to a predetermined computed value for each zone. See the guide for details about which CPU families are available (and defaulted) for each zone.
NumInstances int: Specifies the number of preemptible nodes to create. Defaults to 0.

Accelerators []ClusterClusterConfigMasterConfigAccelerator: The Compute Engine accelerator configuration for these instances. Can be specified multiple times.
DiskConfig ClusterClusterConfigMasterConfigDiskConfig: Disk Config
ImageUri string: The URI for the image to use for this worker. See the guide for more information.
InstanceNames []string
MachineType string: The name of a Google Compute Engine machine type to create for the worker nodes. If not specified, GCP will default to a predetermined computed value (currently n1-standard-4).
MinCpuPlatform string: The name of a minimum generation of CPU family for the master. If not specified, GCP will default to a predetermined computed value for each zone. See the guide for details about which CPU families are available (and defaulted) for each zone.
NumInstances int: Specifies the number of preemptible nodes to create. Defaults to 0.

accelerators ClusterClusterConfigMasterConfigAccelerator[]: The Compute Engine accelerator configuration for these instances. Can be specified multiple times.
diskConfig ClusterClusterConfigMasterConfigDiskConfig: Disk Config
imageUri string: The URI for the image to use for this worker. See the guide for more information.
instanceNames string[]
machineType string: The name of a Google Compute Engine machine type to create for the worker nodes. If not specified, GCP will default to a predetermined computed value (currently n1-standard-4).
minCpuPlatform string: The name of a minimum generation of CPU family for the master. If not specified, GCP will default to a predetermined computed value for each zone. See the guide for details about which CPU families are available (and defaulted) for each zone.
numInstances number: Specifies the number of preemptible nodes to create. Defaults to 0.

accelerators List[ClusterClusterConfigMasterConfigAccelerator]: The Compute Engine accelerator configuration for these instances. Can be specified multiple times.
diskConfig Dict[ClusterClusterConfigMasterConfigDiskConfig]: Disk Config
imageUri str: The URI for the image to use for this worker. See the guide for more information.
instanceNames List[str]
machine_type str: The name of a Google Compute Engine machine type to create for the worker nodes. If not specified, GCP will default to a predetermined computed value (currently n1-standard-4).
min_cpu_platform str: The name of a minimum generation of CPU family for the master. If not specified, GCP will default to a predetermined computed value for each zone. See the guide for details about which CPU families are available (and defaulted) for each zone.
numInstances float: Specifies the number of preemptible nodes to create. Defaults to 0.

ClusterClusterConfigMasterConfigAccelerator

AcceleratorCount int: The number of the accelerator cards of this type exposed to this instance. Often restricted to one of 1, 2, 4, or 8.
AcceleratorType string: The short name of the accelerator type to expose to this instance. For example, nvidia-tesla-k80.

AcceleratorCount int: The number of the accelerator cards of this type exposed to this instance. Often restricted to one of 1, 2, 4, or 8.
AcceleratorType string: The short name of the accelerator type to expose to this instance. For example, nvidia-tesla-k80.

acceleratorCount number: The number of the accelerator cards of this type exposed to this instance. Often restricted to one of 1, 2, 4, or 8.
acceleratorType string: The short name of the accelerator type to expose to this instance. For example, nvidia-tesla-k80.

acceleratorCount float: The number of the accelerator cards of this type exposed to this instance. Often restricted to one of 1, 2, 4, or 8.
accelerator_type str: The short name of the accelerator type to expose to this instance. For example, nvidia-tesla-k80.

ClusterClusterConfigMasterConfigDiskConfig

BootDiskSizeGb int: Size of the primary disk attached to each preemptible worker node, specified in GB. The smallest allowed disk size is 10GB. GCP will default to a predetermined computed value if not set (currently 500GB). Note: If SSDs are not attached, it also contains the HDFS data blocks and Hadoop working directories.
BootDiskType string: The disk type of the primary disk attached to each preemptible worker node. One of "pd-ssd" or "pd-standard". Defaults to "pd-standard".
NumLocalSsds int: The amount of local SSD disks that will be attached to each preemptible worker node. Defaults to 0.

BootDiskSizeGb int: Size of the primary disk attached to each preemptible worker node, specified in GB. The smallest allowed disk size is 10GB. GCP will default to a predetermined computed value if not set (currently 500GB). Note: If SSDs are not attached, it also contains the HDFS data blocks and Hadoop working directories.
BootDiskType string: The disk type of the primary disk attached to each preemptible worker node. One of "pd-ssd" or "pd-standard". Defaults to "pd-standard".
NumLocalSsds int: The amount of local SSD disks that will be attached to each preemptible worker node. Defaults to 0.

bootDiskSizeGb number: Size of the primary disk attached to each preemptible worker node, specified in GB. The smallest allowed disk size is 10GB. GCP will default to a predetermined computed value if not set (currently 500GB). Note: If SSDs are not attached, it also contains the HDFS data blocks and Hadoop working directories.
bootDiskType string: The disk type of the primary disk attached to each preemptible worker node. One of "pd-ssd" or "pd-standard". Defaults to "pd-standard".
numLocalSsds number: The amount of local SSD disks that will be attached to each preemptible worker node. Defaults to 0.

boot_disk_size_gb float: Size of the primary disk attached to each preemptible worker node, specified in GB. The smallest allowed disk size is 10GB. GCP will default to a predetermined computed value if not set (currently 500GB). Note: If SSDs are not attached, it also contains the HDFS data blocks and Hadoop working directories.
boot_disk_type str: The disk type of the primary disk attached to each preemptible worker node. One of "pd-ssd" or "pd-standard". Defaults to "pd-standard".
numLocalSsds float: The amount of local SSD disks that will be attached to each preemptible worker node. Defaults to 0.

ClusterClusterConfigPreemptibleWorkerConfig

DiskConfig ClusterClusterConfigPreemptibleWorkerConfigDiskConfigArgs: Disk Config
InstanceNames List<string>
NumInstances int: Specifies the number of preemptible nodes to create. Defaults to 0.

DiskConfig ClusterClusterConfigPreemptibleWorkerConfigDiskConfig: Disk Config
InstanceNames []string
NumInstances int: Specifies the number of preemptible nodes to create. Defaults to 0.

diskConfig ClusterClusterConfigPreemptibleWorkerConfigDiskConfig: Disk Config
instanceNames string[]
numInstances number: Specifies the number of preemptible nodes to create. Defaults to 0.

diskConfig Dict[ClusterClusterConfigPreemptibleWorkerConfigDiskConfig]: Disk Config
instanceNames List[str]
numInstances float: Specifies the number of preemptible nodes to create. Defaults to 0.

ClusterClusterConfigPreemptibleWorkerConfigDiskConfig

BootDiskSizeGb int: Size of the primary disk attached to each preemptible worker node, specified in GB. The smallest allowed disk size is 10GB. GCP will default to a predetermined computed value if not set (currently 500GB). Note: If SSDs are not attached, it also contains the HDFS data blocks and Hadoop working directories.
BootDiskType string: The disk type of the primary disk attached to each preemptible worker node. One of "pd-ssd" or "pd-standard". Defaults to "pd-standard".
NumLocalSsds int: The amount of local SSD disks that will be attached to each preemptible worker node. Defaults to 0.

BootDiskSizeGb int: Size of the primary disk attached to each preemptible worker node, specified in GB. The smallest allowed disk size is 10GB. GCP will default to a predetermined computed value if not set (currently 500GB). Note: If SSDs are not attached, it also contains the HDFS data blocks and Hadoop working directories.
BootDiskType string: The disk type of the primary disk attached to each preemptible worker node. One of "pd-ssd" or "pd-standard". Defaults to "pd-standard".
NumLocalSsds int: The amount of local SSD disks that will be attached to each preemptible worker node. Defaults to 0.

bootDiskSizeGb number: Size of the primary disk attached to each preemptible worker node, specified in GB. The smallest allowed disk size is 10GB. GCP will default to a predetermined computed value if not set (currently 500GB). Note: If SSDs are not attached, it also contains the HDFS data blocks and Hadoop working directories.
bootDiskType string: The disk type of the primary disk attached to each preemptible worker node. One of "pd-ssd" or "pd-standard". Defaults to "pd-standard".
numLocalSsds number: The amount of local SSD disks that will be attached to each preemptible worker node. Defaults to 0.

boot_disk_size_gb float: Size of the primary disk attached to each preemptible worker node, specified in GB. The smallest allowed disk size is 10GB. GCP will default to a predetermined computed value if not set (currently 500GB). Note: If SSDs are not attached, it also contains the HDFS data blocks and Hadoop working directories.
boot_disk_type str: The disk type of the primary disk attached to each preemptible worker node. One of "pd-ssd" or "pd-standard". Defaults to "pd-standard".
numLocalSsds float: The amount of local SSD disks that will be attached to each preemptible worker node. Defaults to 0.

ClusterClusterConfigSecurityConfig

KerberosConfig ClusterClusterConfigSecurityConfigKerberosConfigArgs: Kerberos Configuration

KerberosConfig ClusterClusterConfigSecurityConfigKerberosConfig: Kerberos Configuration

kerberosConfig ClusterClusterConfigSecurityConfigKerberosConfig: Kerberos Configuration

kerberosConfig Dict[ClusterClusterConfigSecurityConfigKerberosConfig]: Kerberos Configuration

ClusterClusterConfigSecurityConfigKerberosConfig

KmsKeyUri string: The URI of the KMS key used to encrypt various sensitive files.
RootPrincipalPasswordUri string: The Cloud Storage URI of a KMS encrypted file containing the root principal password.
CrossRealmTrustAdminServer string: The admin server (IP or hostname) for the remote trusted realm in a cross realm trust relationship.
CrossRealmTrustKdc string: The KDC (IP or hostname) for the remote trusted realm in a cross realm trust relationship.
CrossRealmTrustRealm string: The remote realm the Dataproc on-cluster KDC will trust, should the user enable cross realm trust.
CrossRealmTrustSharedPasswordUri string: The Cloud Storage URI of a KMS encrypted file containing the shared password between the on-cluster Kerberos realm and the remote trusted realm, in a cross realm trust relationship.
EnableKerberos bool: Flag to indicate whether to Kerberize the cluster.
KdcDbKeyUri string: The Cloud Storage URI of a KMS encrypted file containing the master key of the KDC database.
KeyPasswordUri string: The Cloud Storage URI of a KMS encrypted file containing the password to the user provided key. For the self-signed certificate, this password is generated by Dataproc.
KeystorePasswordUri string: The Cloud Storage URI of a KMS encrypted file containing the password to the user provided keystore. For the self-signed certificated, the password is generated by Dataproc.
KeystoreUri string: The Cloud Storage URI of the keystore file used for SSL encryption. If not provided, Dataproc will provide a self-signed certificate.
Realm string: The name of the on-cluster Kerberos realm. If not specified, the uppercased domain of hostnames will be the realm.
TgtLifetimeHours int: The lifetime of the ticket granting ticket, in hours.
TruststorePasswordUri string: The Cloud Storage URI of a KMS encrypted file containing the password to the user provided truststore. For the self-signed certificate, this password is generated by Dataproc.
TruststoreUri string: The Cloud Storage URI of the truststore file used for SSL encryption. If not provided, Dataproc will provide a self-signed certificate.

KmsKeyUri string: The URI of the KMS key used to encrypt various sensitive files.
RootPrincipalPasswordUri string: The Cloud Storage URI of a KMS encrypted file containing the root principal password.
CrossRealmTrustAdminServer string: The admin server (IP or hostname) for the remote trusted realm in a cross realm trust relationship.
CrossRealmTrustKdc string: The KDC (IP or hostname) for the remote trusted realm in a cross realm trust relationship.
CrossRealmTrustRealm string: The remote realm the Dataproc on-cluster KDC will trust, should the user enable cross realm trust.
CrossRealmTrustSharedPasswordUri string: The Cloud Storage URI of a KMS encrypted file containing the shared password between the on-cluster Kerberos realm and the remote trusted realm, in a cross realm trust relationship.
EnableKerberos bool: Flag to indicate whether to Kerberize the cluster.
KdcDbKeyUri string: The Cloud Storage URI of a KMS encrypted file containing the master key of the KDC database.
KeyPasswordUri string: The Cloud Storage URI of a KMS encrypted file containing the password to the user provided key. For the self-signed certificate, this password is generated by Dataproc.
KeystorePasswordUri string: The Cloud Storage URI of a KMS encrypted file containing the password to the user provided keystore. For the self-signed certificated, the password is generated by Dataproc.
KeystoreUri string: The Cloud Storage URI of the keystore file used for SSL encryption. If not provided, Dataproc will provide a self-signed certificate.
Realm string: The name of the on-cluster Kerberos realm. If not specified, the uppercased domain of hostnames will be the realm.
TgtLifetimeHours int: The lifetime of the ticket granting ticket, in hours.
TruststorePasswordUri string: The Cloud Storage URI of a KMS encrypted file containing the password to the user provided truststore. For the self-signed certificate, this password is generated by Dataproc.
TruststoreUri string: The Cloud Storage URI of the truststore file used for SSL encryption. If not provided, Dataproc will provide a self-signed certificate.

kmsKeyUri string: The URI of the KMS key used to encrypt various sensitive files.
rootPrincipalPasswordUri string: The Cloud Storage URI of a KMS encrypted file containing the root principal password.
crossRealmTrustAdminServer string: The admin server (IP or hostname) for the remote trusted realm in a cross realm trust relationship.
crossRealmTrustKdc string: The KDC (IP or hostname) for the remote trusted realm in a cross realm trust relationship.
crossRealmTrustRealm string: The remote realm the Dataproc on-cluster KDC will trust, should the user enable cross realm trust.
crossRealmTrustSharedPasswordUri string: The Cloud Storage URI of a KMS encrypted file containing the shared password between the on-cluster Kerberos realm and the remote trusted realm, in a cross realm trust relationship.
enableKerberos boolean: Flag to indicate whether to Kerberize the cluster.
kdcDbKeyUri string: The Cloud Storage URI of a KMS encrypted file containing the master key of the KDC database.
keyPasswordUri string: The Cloud Storage URI of a KMS encrypted file containing the password to the user provided key. For the self-signed certificate, this password is generated by Dataproc.
keystorePasswordUri string: The Cloud Storage URI of a KMS encrypted file containing the password to the user provided keystore. For the self-signed certificated, the password is generated by Dataproc.
keystoreUri string: The Cloud Storage URI of the keystore file used for SSL encryption. If not provided, Dataproc will provide a self-signed certificate.
realm string: The name of the on-cluster Kerberos realm. If not specified, the uppercased domain of hostnames will be the realm.
tgtLifetimeHours number: The lifetime of the ticket granting ticket, in hours.
truststorePasswordUri string: The Cloud Storage URI of a KMS encrypted file containing the password to the user provided truststore. For the self-signed certificate, this password is generated by Dataproc.
truststoreUri string: The Cloud Storage URI of the truststore file used for SSL encryption. If not provided, Dataproc will provide a self-signed certificate.

kmsKeyUri str: The URI of the KMS key used to encrypt various sensitive files.
rootPrincipalPasswordUri str: The Cloud Storage URI of a KMS encrypted file containing the root principal password.
crossRealmTrustAdminServer str: The admin server (IP or hostname) for the remote trusted realm in a cross realm trust relationship.
crossRealmTrustKdc str: The KDC (IP or hostname) for the remote trusted realm in a cross realm trust relationship.
crossRealmTrustRealm str: The remote realm the Dataproc on-cluster KDC will trust, should the user enable cross realm trust.
crossRealmTrustSharedPasswordUri str: The Cloud Storage URI of a KMS encrypted file containing the shared password between the on-cluster Kerberos realm and the remote trusted realm, in a cross realm trust relationship.
enableKerberos bool: Flag to indicate whether to Kerberize the cluster.
kdcDbKeyUri str: The Cloud Storage URI of a KMS encrypted file containing the master key of the KDC database.
keyPasswordUri str: The Cloud Storage URI of a KMS encrypted file containing the password to the user provided key. For the self-signed certificate, this password is generated by Dataproc.
keystorePasswordUri str: The Cloud Storage URI of a KMS encrypted file containing the password to the user provided keystore. For the self-signed certificated, the password is generated by Dataproc.
keystoreUri str: The Cloud Storage URI of the keystore file used for SSL encryption. If not provided, Dataproc will provide a self-signed certificate.
realm str: The name of the on-cluster Kerberos realm. If not specified, the uppercased domain of hostnames will be the realm.
tgtLifetimeHours float: The lifetime of the ticket granting ticket, in hours.
truststorePasswordUri str: The Cloud Storage URI of a KMS encrypted file containing the password to the user provided truststore. For the self-signed certificate, this password is generated by Dataproc.
truststoreUri str: The Cloud Storage URI of the truststore file used for SSL encryption. If not provided, Dataproc will provide a self-signed certificate.

ClusterClusterConfigSoftwareConfig

ImageVersion string: The Cloud Dataproc image version to use for the cluster - this controls the sets of software versions installed onto the nodes when you create clusters. If not specified, defaults to the latest version. For a list of valid versions see Cloud Dataproc versions
OptionalComponents List<string>: The set of optional components to activate on the cluster. Accepted values are: * ANACONDA * DRUID * HBASE * HIVE_WEBHCAT * JUPYTER * KERBEROS * PRESTO * RANGER * SOLR * ZEPPELIN * ZOOKEEPER
OverrideProperties Dictionary<string, string>: A list of override and additional properties (key/value pairs) used to modify various aspects of the common configuration files used when creating a cluster. For a list of valid properties please see Cluster properties
Properties Dictionary<string, object>

ImageVersion string: The Cloud Dataproc image version to use for the cluster - this controls the sets of software versions installed onto the nodes when you create clusters. If not specified, defaults to the latest version. For a list of valid versions see Cloud Dataproc versions
OptionalComponents []string: The set of optional components to activate on the cluster. Accepted values are: * ANACONDA * DRUID * HBASE * HIVE_WEBHCAT * JUPYTER * KERBEROS * PRESTO * RANGER * SOLR * ZEPPELIN * ZOOKEEPER
OverrideProperties map[string]string: A list of override and additional properties (key/value pairs) used to modify various aspects of the common configuration files used when creating a cluster. For a list of valid properties please see Cluster properties
Properties map[string]interface{}

imageVersion string: The Cloud Dataproc image version to use for the cluster - this controls the sets of software versions installed onto the nodes when you create clusters. If not specified, defaults to the latest version. For a list of valid versions see Cloud Dataproc versions
optionalComponents string[]: The set of optional components to activate on the cluster. Accepted values are: * ANACONDA * DRUID * HBASE * HIVE_WEBHCAT * JUPYTER * KERBEROS * PRESTO * RANGER * SOLR * ZEPPELIN * ZOOKEEPER
overrideProperties {[key: string]: string}: A list of override and additional properties (key/value pairs) used to modify various aspects of the common configuration files used when creating a cluster. For a list of valid properties please see Cluster properties
properties {[key: string]: any}

imageVersion str: The Cloud Dataproc image version to use for the cluster - this controls the sets of software versions installed onto the nodes when you create clusters. If not specified, defaults to the latest version. For a list of valid versions see Cloud Dataproc versions
optionalComponents List[str]: The set of optional components to activate on the cluster. Accepted values are: * ANACONDA * DRUID * HBASE * HIVE_WEBHCAT * JUPYTER * KERBEROS * PRESTO * RANGER * SOLR * ZEPPELIN * ZOOKEEPER
overrideProperties Dict[str, str]: A list of override and additional properties (key/value pairs) used to modify various aspects of the common configuration files used when creating a cluster. For a list of valid properties please see Cluster properties
properties Dict[str, Any]

ClusterClusterConfigWorkerConfig

Accelerators List<ClusterClusterConfigWorkerConfigAcceleratorArgs>: The Compute Engine accelerator configuration for these instances. Can be specified multiple times.
DiskConfig ClusterClusterConfigWorkerConfigDiskConfigArgs: Disk Config
ImageUri string: The URI for the image to use for this worker. See the guide for more information.
InstanceNames List<string>
MachineType string: The name of a Google Compute Engine machine type to create for the worker nodes. If not specified, GCP will default to a predetermined computed value (currently n1-standard-4).
MinCpuPlatform string: The name of a minimum generation of CPU family for the master. If not specified, GCP will default to a predetermined computed value for each zone. See the guide for details about which CPU families are available (and defaulted) for each zone.
NumInstances int: Specifies the number of preemptible nodes to create. Defaults to 0.

Accelerators []ClusterClusterConfigWorkerConfigAccelerator: The Compute Engine accelerator configuration for these instances. Can be specified multiple times.
DiskConfig ClusterClusterConfigWorkerConfigDiskConfig: Disk Config
ImageUri string: The URI for the image to use for this worker. See the guide for more information.
InstanceNames []string
MachineType string: The name of a Google Compute Engine machine type to create for the worker nodes. If not specified, GCP will default to a predetermined computed value (currently n1-standard-4).
MinCpuPlatform string: The name of a minimum generation of CPU family for the master. If not specified, GCP will default to a predetermined computed value for each zone. See the guide for details about which CPU families are available (and defaulted) for each zone.
NumInstances int: Specifies the number of preemptible nodes to create. Defaults to 0.

accelerators ClusterClusterConfigWorkerConfigAccelerator[]: The Compute Engine accelerator configuration for these instances. Can be specified multiple times.
diskConfig ClusterClusterConfigWorkerConfigDiskConfig: Disk Config
imageUri string: The URI for the image to use for this worker. See the guide for more information.
instanceNames string[]
machineType string: The name of a Google Compute Engine machine type to create for the worker nodes. If not specified, GCP will default to a predetermined computed value (currently n1-standard-4).
minCpuPlatform string: The name of a minimum generation of CPU family for the master. If not specified, GCP will default to a predetermined computed value for each zone. See the guide for details about which CPU families are available (and defaulted) for each zone.
numInstances number: Specifies the number of preemptible nodes to create. Defaults to 0.

accelerators List[ClusterClusterConfigWorkerConfigAccelerator]: The Compute Engine accelerator configuration for these instances. Can be specified multiple times.
diskConfig Dict[ClusterClusterConfigWorkerConfigDiskConfig]: Disk Config
imageUri str: The URI for the image to use for this worker. See the guide for more information.
instanceNames List[str]
machine_type str: The name of a Google Compute Engine machine type to create for the worker nodes. If not specified, GCP will default to a predetermined computed value (currently n1-standard-4).
min_cpu_platform str: The name of a minimum generation of CPU family for the master. If not specified, GCP will default to a predetermined computed value for each zone. See the guide for details about which CPU families are available (and defaulted) for each zone.
numInstances float: Specifies the number of preemptible nodes to create. Defaults to 0.

ClusterClusterConfigWorkerConfigAccelerator

AcceleratorCount int: The number of the accelerator cards of this type exposed to this instance. Often restricted to one of 1, 2, 4, or 8.
AcceleratorType string: The short name of the accelerator type to expose to this instance. For example, nvidia-tesla-k80.

AcceleratorCount int: The number of the accelerator cards of this type exposed to this instance. Often restricted to one of 1, 2, 4, or 8.
AcceleratorType string: The short name of the accelerator type to expose to this instance. For example, nvidia-tesla-k80.

acceleratorCount number: The number of the accelerator cards of this type exposed to this instance. Often restricted to one of 1, 2, 4, or 8.
acceleratorType string: The short name of the accelerator type to expose to this instance. For example, nvidia-tesla-k80.

acceleratorCount float: The number of the accelerator cards of this type exposed to this instance. Often restricted to one of 1, 2, 4, or 8.
accelerator_type str: The short name of the accelerator type to expose to this instance. For example, nvidia-tesla-k80.

ClusterClusterConfigWorkerConfigDiskConfig

BootDiskSizeGb int: Size of the primary disk attached to each preemptible worker node, specified in GB. The smallest allowed disk size is 10GB. GCP will default to a predetermined computed value if not set (currently 500GB). Note: If SSDs are not attached, it also contains the HDFS data blocks and Hadoop working directories.
BootDiskType string: The disk type of the primary disk attached to each preemptible worker node. One of "pd-ssd" or "pd-standard". Defaults to "pd-standard".
NumLocalSsds int: The amount of local SSD disks that will be attached to each preemptible worker node. Defaults to 0.

BootDiskSizeGb int: Size of the primary disk attached to each preemptible worker node, specified in GB. The smallest allowed disk size is 10GB. GCP will default to a predetermined computed value if not set (currently 500GB). Note: If SSDs are not attached, it also contains the HDFS data blocks and Hadoop working directories.
BootDiskType string: The disk type of the primary disk attached to each preemptible worker node. One of "pd-ssd" or "pd-standard". Defaults to "pd-standard".
NumLocalSsds int: The amount of local SSD disks that will be attached to each preemptible worker node. Defaults to 0.

bootDiskSizeGb number: Size of the primary disk attached to each preemptible worker node, specified in GB. The smallest allowed disk size is 10GB. GCP will default to a predetermined computed value if not set (currently 500GB). Note: If SSDs are not attached, it also contains the HDFS data blocks and Hadoop working directories.
bootDiskType string: The disk type of the primary disk attached to each preemptible worker node. One of "pd-ssd" or "pd-standard". Defaults to "pd-standard".
numLocalSsds number: The amount of local SSD disks that will be attached to each preemptible worker node. Defaults to 0.

boot_disk_size_gb float: Size of the primary disk attached to each preemptible worker node, specified in GB. The smallest allowed disk size is 10GB. GCP will default to a predetermined computed value if not set (currently 500GB). Note: If SSDs are not attached, it also contains the HDFS data blocks and Hadoop working directories.
boot_disk_type str: The disk type of the primary disk attached to each preemptible worker node. One of "pd-ssd" or "pd-standard". Defaults to "pd-standard".
numLocalSsds float: The amount of local SSD disks that will be attached to each preemptible worker node. Defaults to 0.

Package Details

Repository: https://github.com/pulumi/pulumi-gcp
License: Apache-2.0
Notes: This Pulumi package is based on the google-beta Terraform Provider.

The Pulumi Platform

Get Started

Migrate to Pulumi

Solutions for All Teams and Engineers

Any Code

Any Cloud