Module dataproc

This page documents the language specification for the gcp package. If you're looking for help working with the inputs, outputs, or functions of gcp resources in a Pulumi program, please see the resource documentation for examples and API reference.

Resources

AutoscalingPolicy
Cluster
ClusterIAMBinding
ClusterIAMMember
ClusterIAMPolicy
Job
JobIAMBinding
JobIAMMember
JobIAMPolicy

Others

AutoscalingPolicyArgs
AutoscalingPolicyState
ClusterArgs
ClusterIAMBindingArgs
ClusterIAMBindingState
ClusterIAMMemberArgs
ClusterIAMMemberState
ClusterIAMPolicyArgs
ClusterIAMPolicyState
ClusterState
JobArgs
JobIAMBindingArgs
JobIAMBindingState
JobIAMMemberArgs
JobIAMMemberState
JobIAMPolicyArgs
JobIAMPolicyState
JobState

Resources

Resource AutoscalingPolicy

class AutoscalingPolicy extends CustomResource

Describes an autoscaling policy for Dataproc cluster autoscaler.

Example Usage - Dataproc Autoscaling Policy

import * as pulumi from "@pulumi/pulumi";
import * as gcp from "@pulumi/gcp";

const asp = new gcp.dataproc.AutoscalingPolicy("asp", {
    policyId: "dataproc-policy",
    location: "us-central1",
    worker_config: {
        maxInstances: 3,
    },
    basic_algorithm: {
        yarn_config: {
            gracefulDecommissionTimeout: "30s",
            scaleUpFactor: 0.5,
            scaleDownFactor: 0.5,
        },
    },
});
const basic = new gcp.dataproc.Cluster("basic", {
    region: "us-central1",
    cluster_config: {
        autoscaling_config: {
            policyUri: asp.name,
        },
    },
});

constructor

new AutoscalingPolicy(name: string, args: AutoscalingPolicyArgs, opts?: pulumi.CustomResourceOptions)

Create a AutoscalingPolicy resource with the given unique name, arguments, and options.

name The unique name of the resource.
args The arguments to use to populate this resource's properties.
opts A bag of options that control this resource's behavior.

method get

public static get(name: string, id: pulumi.Input<pulumi.ID>, state?: AutoscalingPolicyState, opts?: pulumi.CustomResourceOptions): AutoscalingPolicy

Get an existing AutoscalingPolicy resource’s state with the given name, ID, and optional extra properties used to qualify the lookup.

method getProvider

getProvider(moduleMember: string): ProviderResource | undefined

method isInstance

public static isInstance(obj: any): obj is AutoscalingPolicy

Returns true if the given object is an instance of AutoscalingPolicy. This is designed to work even when multiple copies of the Pulumi SDK have been loaded into the same process.

property basicAlgorithm

public basicAlgorithm: pulumi.Output<AutoscalingPolicyBasicAlgorithm | undefined>;

Basic algorithm for autoscaling. Structure is documented below.

property id

id: Output<ID>;

id is the provider-assigned unique ID for this managed resource. It is set during deployments and may be missing (undefined) during planning phases.

property location

public location: pulumi.Output<string | undefined>;

The location where the autoscaling poicy should reside. The default value is global.

property name

public name: pulumi.Output<string>;

The “resource name” of the autoscaling policy.

property policyId

public policyId: pulumi.Output<string>;

The policy id. The id must contain only letters (a-z, A-Z), numbers (0-9), underscores (_), and hyphens (-). Cannot begin or end with underscore or hyphen. Must consist of between 3 and 50 characters.

property project

public project: pulumi.Output<string>;

The ID of the project in which the resource belongs. If it is not provided, the provider project is used.

property secondaryWorkerConfig

public secondaryWorkerConfig: pulumi.Output<AutoscalingPolicySecondaryWorkerConfig | undefined>;

Describes how the autoscaler will operate for secondary workers. Structure is documented below.

property urn

urn: Output<URN>;

urn is the stable logical URN used to distinctly address a resource, both before and after deployments.

property workerConfig

public workerConfig: pulumi.Output<AutoscalingPolicyWorkerConfig | undefined>;

Describes how the autoscaler will operate for primary workers. Structure is documented below.

Resource Cluster

class Cluster extends CustomResource

Manages a Cloud Dataproc cluster resource within GCP. For more information see the official dataproc documentation.

!> Warning: Due to limitations of the API, all arguments except labels,cluster_config.worker_config.num_instances and cluster_config.preemptible_worker_config.num_instances are non-updatable. Changing others will cause recreation of the whole cluster!

Example Usage - Basic

import * as pulumi from "@pulumi/pulumi";
import * as gcp from "@pulumi/gcp";

const simplecluster = new gcp.dataproc.Cluster("simplecluster", {
    region: "us-central1",
});

Example Usage - Advanced

import * as pulumi from "@pulumi/pulumi";
import * as gcp from "@pulumi/gcp";

const mycluster = new gcp.dataproc.Cluster("mycluster", {
    clusterConfig: {
        gceClusterConfig: {
            serviceAccountScopes: [
                "https://www.googleapis.com/auth/monitoring",
                "useraccounts-ro",
                "storage-rw",
                "logging-write",
            ],
            tags: [
                "foo",
                "bar",
            ],
        },
        // You can define multiple initializationAction blocks
        initializationActions: [{
            script: "gs://dataproc-initialization-actions/stackdriver/stackdriver.sh",
            timeoutSec: 500,
        }],
        masterConfig: {
            diskConfig: {
                bootDiskSizeGb: 15,
                bootDiskType: "pd-ssd",
            },
            machineType: "n1-standard-1",
            numInstances: 1,
        },
        preemptibleWorkerConfig: {
            numInstances: 0,
        },
        // Override or set some custom properties
        softwareConfig: {
            imageVersion: "1.3.7-deb9",
            overrideProperties: {
                "dataproc:dataproc.allow.zero.workers": "true",
            },
        },
        stagingBucket: "dataproc-staging-bucket",
        workerConfig: {
            diskConfig: {
                bootDiskSizeGb: 15,
                numLocalSsds: 1,
            },
            machineType: "n1-standard-1",
            minCpuPlatform: "Intel Skylake",
            numInstances: 2,
        },
    },
    labels: {
        foo: "bar",
    },
    region: "us-central1",
});

Example Usage - Using a GPU accelerator

import * as pulumi from "@pulumi/pulumi";
import * as gcp from "@pulumi/gcp";

const acceleratedCluster = new gcp.dataproc.Cluster("acceleratedCluster", {
    clusterConfig: {
        gceClusterConfig: {
            zone: "us-central1-a",
        },
        masterConfig: {
            accelerators: [{
                acceleratorCount: 1,
                acceleratorType: "nvidia-tesla-k80",
            }],
        },
    },
    region: "us-central1",
});

constructor

new Cluster(name: string, args?: ClusterArgs, opts?: pulumi.CustomResourceOptions)

Create a Cluster resource with the given unique name, arguments, and options.

name The unique name of the resource.
args The arguments to use to populate this resource's properties.
opts A bag of options that control this resource's behavior.

method get

public static get(name: string, id: pulumi.Input<pulumi.ID>, state?: ClusterState, opts?: pulumi.CustomResourceOptions): Cluster

Get an existing Cluster resource’s state with the given name, ID, and optional extra properties used to qualify the lookup.

method getProvider

getProvider(moduleMember: string): ProviderResource | undefined

method isInstance

public static isInstance(obj: any): obj is Cluster

Returns true if the given object is an instance of Cluster. This is designed to work even when multiple copies of the Pulumi SDK have been loaded into the same process.

property clusterConfig

public clusterConfig: pulumi.Output<ClusterClusterConfig>;

Allows you to configure various aspects of the cluster. Structure defined below.

property id

id: Output<ID>;

id is the provider-assigned unique ID for this managed resource. It is set during deployments and may be missing (undefined) during planning phases.

property labels

public labels: pulumi.Output<{[key: string]: string}>;

The list of labels (key/value pairs) to be applied to instances in the cluster. GCP generates some itself including goog-dataproc-cluster-name which is the name of the cluster.

property name

public name: pulumi.Output<string>;

The name of the cluster, unique within the project and zone.

property project

public project: pulumi.Output<string>;

The ID of the project in which the cluster will exist. If it is not provided, the provider project is used.

property region

public region: pulumi.Output<string | undefined>;

The region in which the cluster and associated nodes will be created in. Defaults to global.

property urn

urn: Output<URN>;

urn is the stable logical URN used to distinctly address a resource, both before and after deployments.

Resource ClusterIAMBinding

class ClusterIAMBinding extends CustomResource

Three different resources help you manage IAM policies on dataproc clusters. Each of these resources serves a different use case:

gcp.dataproc.ClusterIAMPolicy: Authoritative. Sets the IAM policy for the cluster and replaces any existing policy already attached.
gcp.dataproc.ClusterIAMBinding: Authoritative for a given role. Updates the IAM policy to grant a role to a list of members. Other roles within the IAM policy for the cluster are preserved.
gcp.dataproc.ClusterIAMMember: Non-authoritative. Updates the IAM policy to grant a role to a new member. Other members for the role for the cluster are preserved.

Note: gcp.dataproc.ClusterIAMPolicy cannot be used in conjunction with gcp.dataproc.ClusterIAMBinding and gcp.dataproc.ClusterIAMMember or they will fight over what your policy should be. In addition, be careful not to accidentally unset ownership of the cluster as gcp.dataproc.ClusterIAMPolicy replaces the entire policy.
Note: gcp.dataproc.ClusterIAMBinding resources can be used in conjunction with gcp.dataproc.ClusterIAMMember resources only if they do not grant privilege to the same role.

google_pubsub_subscription_iam_policy

import * as pulumi from "@pulumi/pulumi";
import * as gcp from "@pulumi/gcp";

const admin = gcp.organizations.getIAMPolicy({
    binding: [{
        role: "roles/editor",
        members: ["user:jane@example.com"],
    }],
});
const editor = new gcp.dataproc.ClusterIAMPolicy("editor", {
    project: "your-project",
    region: "your-region",
    cluster: "your-dataproc-cluster",
    policyData: admin.then(admin => admin.policyData),
});

google_pubsub_subscription_iam_binding

import * as pulumi from "@pulumi/pulumi";
import * as gcp from "@pulumi/gcp";

const editor = new gcp.dataproc.ClusterIAMBinding("editor", {
    cluster: "your-dataproc-cluster",
    members: ["user:jane@example.com"],
    role: "roles/editor",
});

google_pubsub_subscription_iam_member

import * as pulumi from "@pulumi/pulumi";
import * as gcp from "@pulumi/gcp";

const editor = new gcp.dataproc.ClusterIAMMember("editor", {
    cluster: "your-dataproc-cluster",
    member: "user:jane@example.com",
    role: "roles/editor",
});

constructor

new ClusterIAMBinding(name: string, args: ClusterIAMBindingArgs, opts?: pulumi.CustomResourceOptions)

Create a ClusterIAMBinding resource with the given unique name, arguments, and options.

name The unique name of the resource.
args The arguments to use to populate this resource's properties.
opts A bag of options that control this resource's behavior.

method get

public static get(name: string, id: pulumi.Input<pulumi.ID>, state?: ClusterIAMBindingState, opts?: pulumi.CustomResourceOptions): ClusterIAMBinding

Get an existing ClusterIAMBinding resource’s state with the given name, ID, and optional extra properties used to qualify the lookup.

method getProvider

getProvider(moduleMember: string): ProviderResource | undefined

method isInstance

public static isInstance(obj: any): obj is ClusterIAMBinding

Returns true if the given object is an instance of ClusterIAMBinding. This is designed to work even when multiple copies of the Pulumi SDK have been loaded into the same process.

property cluster

public cluster: pulumi.Output<string>;

The name or relative resource id of the cluster to manage IAM policies for.

property condition

public condition: pulumi.Output<ClusterIAMBindingCondition | undefined>;

property etag

public etag: pulumi.Output<string>;

(Computed) The etag of the clusters’s IAM policy.

property id

id: Output<ID>;

id is the provider-assigned unique ID for this managed resource. It is set during deployments and may be missing (undefined) during planning phases.

property members

public members: pulumi.Output<string[]>;

property project

public project: pulumi.Output<string>;

The project in which the cluster belongs. If it is not provided, the provider will use a default.

property region

public region: pulumi.Output<string>;

The region in which the cluster belongs. If it is not provided, the provider will use a default.

property role

public role: pulumi.Output<string>;

The role that should be applied. Only one gcp.dataproc.ClusterIAMBinding can be used per role. Note that custom roles must be of the format [projects|organizations]/{parent-name}/roles/{role-name}.

property urn

urn: Output<URN>;

urn is the stable logical URN used to distinctly address a resource, both before and after deployments.

Resource ClusterIAMMember

class ClusterIAMMember extends CustomResource

Three different resources help you manage IAM policies on dataproc clusters. Each of these resources serves a different use case:

gcp.dataproc.ClusterIAMPolicy: Authoritative. Sets the IAM policy for the cluster and replaces any existing policy already attached.
gcp.dataproc.ClusterIAMBinding: Authoritative for a given role. Updates the IAM policy to grant a role to a list of members. Other roles within the IAM policy for the cluster are preserved.
gcp.dataproc.ClusterIAMMember: Non-authoritative. Updates the IAM policy to grant a role to a new member. Other members for the role for the cluster are preserved.

Note: gcp.dataproc.ClusterIAMPolicy cannot be used in conjunction with gcp.dataproc.ClusterIAMBinding and gcp.dataproc.ClusterIAMMember or they will fight over what your policy should be. In addition, be careful not to accidentally unset ownership of the cluster as gcp.dataproc.ClusterIAMPolicy replaces the entire policy.
Note: gcp.dataproc.ClusterIAMBinding resources can be used in conjunction with gcp.dataproc.ClusterIAMMember resources only if they do not grant privilege to the same role.

google_pubsub_subscription_iam_policy

import * as pulumi from "@pulumi/pulumi";
import * as gcp from "@pulumi/gcp";

const admin = gcp.organizations.getIAMPolicy({
    binding: [{
        role: "roles/editor",
        members: ["user:jane@example.com"],
    }],
});
const editor = new gcp.dataproc.ClusterIAMPolicy("editor", {
    project: "your-project",
    region: "your-region",
    cluster: "your-dataproc-cluster",
    policyData: admin.then(admin => admin.policyData),
});

google_pubsub_subscription_iam_binding

import * as pulumi from "@pulumi/pulumi";
import * as gcp from "@pulumi/gcp";

const editor = new gcp.dataproc.ClusterIAMBinding("editor", {
    cluster: "your-dataproc-cluster",
    members: ["user:jane@example.com"],
    role: "roles/editor",
});

google_pubsub_subscription_iam_member

import * as pulumi from "@pulumi/pulumi";
import * as gcp from "@pulumi/gcp";

const editor = new gcp.dataproc.ClusterIAMMember("editor", {
    cluster: "your-dataproc-cluster",
    member: "user:jane@example.com",
    role: "roles/editor",
});

constructor

new ClusterIAMMember(name: string, args: ClusterIAMMemberArgs, opts?: pulumi.CustomResourceOptions)

Create a ClusterIAMMember resource with the given unique name, arguments, and options.

name The unique name of the resource.
args The arguments to use to populate this resource's properties.
opts A bag of options that control this resource's behavior.

method get

public static get(name: string, id: pulumi.Input<pulumi.ID>, state?: ClusterIAMMemberState, opts?: pulumi.CustomResourceOptions): ClusterIAMMember

Get an existing ClusterIAMMember resource’s state with the given name, ID, and optional extra properties used to qualify the lookup.

method getProvider

getProvider(moduleMember: string): ProviderResource | undefined

method isInstance

public static isInstance(obj: any): obj is ClusterIAMMember

Returns true if the given object is an instance of ClusterIAMMember. This is designed to work even when multiple copies of the Pulumi SDK have been loaded into the same process.

property cluster

public cluster: pulumi.Output<string>;

The name or relative resource id of the cluster to manage IAM policies for.

property condition

public condition: pulumi.Output<ClusterIAMMemberCondition | undefined>;

property etag

public etag: pulumi.Output<string>;

(Computed) The etag of the clusters’s IAM policy.

property id

id: Output<ID>;

id is the provider-assigned unique ID for this managed resource. It is set during deployments and may be missing (undefined) during planning phases.

property member

public member: pulumi.Output<string>;

property project

public project: pulumi.Output<string>;

The project in which the cluster belongs. If it is not provided, the provider will use a default.

property region

public region: pulumi.Output<string>;

The region in which the cluster belongs. If it is not provided, the provider will use a default.

property role

public role: pulumi.Output<string>;

property urn

urn: Output<URN>;

urn is the stable logical URN used to distinctly address a resource, both before and after deployments.

Resource ClusterIAMPolicy

class ClusterIAMPolicy extends CustomResource

Three different resources help you manage IAM policies on dataproc clusters. Each of these resources serves a different use case:

gcp.dataproc.ClusterIAMPolicy: Authoritative. Sets the IAM policy for the cluster and replaces any existing policy already attached.
gcp.dataproc.ClusterIAMBinding: Authoritative for a given role. Updates the IAM policy to grant a role to a list of members. Other roles within the IAM policy for the cluster are preserved.
gcp.dataproc.ClusterIAMMember: Non-authoritative. Updates the IAM policy to grant a role to a new member. Other members for the role for the cluster are preserved.

Note: gcp.dataproc.ClusterIAMPolicy cannot be used in conjunction with gcp.dataproc.ClusterIAMBinding and gcp.dataproc.ClusterIAMMember or they will fight over what your policy should be. In addition, be careful not to accidentally unset ownership of the cluster as gcp.dataproc.ClusterIAMPolicy replaces the entire policy.
Note: gcp.dataproc.ClusterIAMBinding resources can be used in conjunction with gcp.dataproc.ClusterIAMMember resources only if they do not grant privilege to the same role.

google_pubsub_subscription_iam_policy

import * as pulumi from "@pulumi/pulumi";
import * as gcp from "@pulumi/gcp";

const admin = gcp.organizations.getIAMPolicy({
    binding: [{
        role: "roles/editor",
        members: ["user:jane@example.com"],
    }],
});
const editor = new gcp.dataproc.ClusterIAMPolicy("editor", {
    project: "your-project",
    region: "your-region",
    cluster: "your-dataproc-cluster",
    policyData: admin.then(admin => admin.policyData),
});

google_pubsub_subscription_iam_binding

import * as pulumi from "@pulumi/pulumi";
import * as gcp from "@pulumi/gcp";

const editor = new gcp.dataproc.ClusterIAMBinding("editor", {
    cluster: "your-dataproc-cluster",
    members: ["user:jane@example.com"],
    role: "roles/editor",
});

google_pubsub_subscription_iam_member

import * as pulumi from "@pulumi/pulumi";
import * as gcp from "@pulumi/gcp";

const editor = new gcp.dataproc.ClusterIAMMember("editor", {
    cluster: "your-dataproc-cluster",
    member: "user:jane@example.com",
    role: "roles/editor",
});

constructor

new ClusterIAMPolicy(name: string, args: ClusterIAMPolicyArgs, opts?: pulumi.CustomResourceOptions)

Create a ClusterIAMPolicy resource with the given unique name, arguments, and options.

name The unique name of the resource.
args The arguments to use to populate this resource's properties.
opts A bag of options that control this resource's behavior.

method get

public static get(name: string, id: pulumi.Input<pulumi.ID>, state?: ClusterIAMPolicyState, opts?: pulumi.CustomResourceOptions): ClusterIAMPolicy

Get an existing ClusterIAMPolicy resource’s state with the given name, ID, and optional extra properties used to qualify the lookup.

method getProvider

getProvider(moduleMember: string): ProviderResource | undefined

method isInstance

public static isInstance(obj: any): obj is ClusterIAMPolicy

Returns true if the given object is an instance of ClusterIAMPolicy. This is designed to work even when multiple copies of the Pulumi SDK have been loaded into the same process.

property cluster

public cluster: pulumi.Output<string>;

The name or relative resource id of the cluster to manage IAM policies for.

property etag

public etag: pulumi.Output<string>;

(Computed) The etag of the clusters’s IAM policy.

property id

id: Output<ID>;

id is the provider-assigned unique ID for this managed resource. It is set during deployments and may be missing (undefined) during planning phases.

property policyData

public policyData: pulumi.Output<string>;

The policy data generated by a gcp.organizations.getIAMPolicy data source.

property project

public project: pulumi.Output<string>;

The project in which the cluster belongs. If it is not provided, the provider will use a default.

property region

public region: pulumi.Output<string>;

The region in which the cluster belongs. If it is not provided, the provider will use a default.

property urn

urn: Output<URN>;

urn is the stable logical URN used to distinctly address a resource, both before and after deployments.

Resource Job

class Job extends CustomResource

Manages a job resource within a Dataproc cluster within GCE. For more information see the official dataproc documentation.

!> Note: This resource does not support ‘update’ and changing any attributes will cause the resource to be recreated.

constructor

new Job(name: string, args: JobArgs, opts?: pulumi.CustomResourceOptions)

Create a Job resource with the given unique name, arguments, and options.

name The unique name of the resource.
args The arguments to use to populate this resource's properties.
opts A bag of options that control this resource's behavior.

method get

public static get(name: string, id: pulumi.Input<pulumi.ID>, state?: JobState, opts?: pulumi.CustomResourceOptions): Job

Get an existing Job resource’s state with the given name, ID, and optional extra properties used to qualify the lookup.

method getProvider

getProvider(moduleMember: string): ProviderResource | undefined

method isInstance

public static isInstance(obj: any): obj is Job

Returns true if the given object is an instance of Job. This is designed to work even when multiple copies of the Pulumi SDK have been loaded into the same process.

property driverControlsFilesUri

public driverControlsFilesUri: pulumi.Output<string>;

If present, the location of miscellaneous control files which may be used as part of job setup and handling. If not present, control files may be placed in the same location as driver_output_uri.

property driverOutputResourceUri

public driverOutputResourceUri: pulumi.Output<string>;

A URI pointing to the location of the stdout of the job’s driver program.

property forceDelete

public forceDelete: pulumi.Output<boolean | undefined>;

By default, you can only delete inactive jobs within Dataproc. Setting this to true, and calling destroy, will ensure that the job is first cancelled before issuing the delete.

property hadoopConfig

public hadoopConfig: pulumi.Output<JobHadoopConfig | undefined>;

property hiveConfig

public hiveConfig: pulumi.Output<JobHiveConfig | undefined>;

property id

id: Output<ID>;

id is the provider-assigned unique ID for this managed resource. It is set during deployments and may be missing (undefined) during planning phases.

property labels

public labels: pulumi.Output<{[key: string]: string} | undefined>;

The list of labels (key/value pairs) to add to the job.

property pigConfig

public pigConfig: pulumi.Output<JobPigConfig | undefined>;

property placement

public placement: pulumi.Output<JobPlacement>;

property project

public project: pulumi.Output<string>;

The project in which the cluster can be found and jobs subsequently run against. If it is not provided, the provider project is used.

property pysparkConfig

public pysparkConfig: pulumi.Output<JobPysparkConfig | undefined>;

property reference

public reference: pulumi.Output<JobReference>;

property region

public region: pulumi.Output<string | undefined>;

The Cloud Dataproc region. This essentially determines which clusters are available for this job to be submitted to. If not specified, defaults to global.

property scheduling

public scheduling: pulumi.Output<JobScheduling | undefined>;

Optional. Job scheduling configuration.

property sparkConfig

public sparkConfig: pulumi.Output<JobSparkConfig | undefined>;

property sparksqlConfig

public sparksqlConfig: pulumi.Output<JobSparksqlConfig | undefined>;

property status

public status: pulumi.Output<JobStatus>;

property urn

urn: Output<URN>;

urn is the stable logical URN used to distinctly address a resource, both before and after deployments.

Resource JobIAMBinding

class JobIAMBinding extends CustomResource

Three different resources help you manage IAM policies on dataproc jobs. Each of these resources serves a different use case:

gcp.dataproc.JobIAMPolicy: Authoritative. Sets the IAM policy for the job and replaces any existing policy already attached.
gcp.dataproc.JobIAMBinding: Authoritative for a given role. Updates the IAM policy to grant a role to a list of members. Other roles within the IAM policy for the job are preserved.
gcp.dataproc.JobIAMMember: Non-authoritative. Updates the IAM policy to grant a role to a new member. Other members for the role for the job are preserved.

Note: gcp.dataproc.JobIAMPolicy cannot be used in conjunction with gcp.dataproc.JobIAMBinding and gcp.dataproc.JobIAMMember or they will fight over what your policy should be. In addition, be careful not to accidentally unset ownership of the job as gcp.dataproc.JobIAMPolicy replaces the entire policy.
Note: gcp.dataproc.JobIAMBinding resources can be used in conjunction with gcp.dataproc.JobIAMMember resources only if they do not grant privilege to the same role.

google_pubsub_subscription_iam_policy

import * as pulumi from "@pulumi/pulumi";
import * as gcp from "@pulumi/gcp";

const admin = gcp.organizations.getIAMPolicy({
    binding: [{
        role: "roles/editor",
        members: ["user:jane@example.com"],
    }],
});
const editor = new gcp.dataproc.JobIAMPolicy("editor", {
    project: "your-project",
    region: "your-region",
    jobId: "your-dataproc-job",
    policyData: admin.then(admin => admin.policyData),
});

google_pubsub_subscription_iam_binding

import * as pulumi from "@pulumi/pulumi";
import * as gcp from "@pulumi/gcp";

const editor = new gcp.dataproc.JobIAMBinding("editor", {
    jobId: "your-dataproc-job",
    members: ["user:jane@example.com"],
    role: "roles/editor",
});

google_pubsub_subscription_iam_member

import * as pulumi from "@pulumi/pulumi";
import * as gcp from "@pulumi/gcp";

const editor = new gcp.dataproc.JobIAMMember("editor", {
    jobId: "your-dataproc-job",
    member: "user:jane@example.com",
    role: "roles/editor",
});

constructor

new JobIAMBinding(name: string, args: JobIAMBindingArgs, opts?: pulumi.CustomResourceOptions)

Create a JobIAMBinding resource with the given unique name, arguments, and options.

name The unique name of the resource.
args The arguments to use to populate this resource's properties.
opts A bag of options that control this resource's behavior.

method get

public static get(name: string, id: pulumi.Input<pulumi.ID>, state?: JobIAMBindingState, opts?: pulumi.CustomResourceOptions): JobIAMBinding

Get an existing JobIAMBinding resource’s state with the given name, ID, and optional extra properties used to qualify the lookup.

method getProvider

getProvider(moduleMember: string): ProviderResource | undefined

method isInstance

public static isInstance(obj: any): obj is JobIAMBinding

Returns true if the given object is an instance of JobIAMBinding. This is designed to work even when multiple copies of the Pulumi SDK have been loaded into the same process.

property condition

public condition: pulumi.Output<JobIAMBindingCondition | undefined>;

property etag

public etag: pulumi.Output<string>;

(Computed) The etag of the jobs’s IAM policy.

property id

id: Output<ID>;

id is the provider-assigned unique ID for this managed resource. It is set during deployments and may be missing (undefined) during planning phases.

property jobId

public jobId: pulumi.Output<string>;

property members

public members: pulumi.Output<string[]>;

property project

public project: pulumi.Output<string>;

The project in which the job belongs. If it is not provided, the provider will use a default.

property region

public region: pulumi.Output<string>;

The region in which the job belongs. If it is not provided, the provider will use a default.

property role

public role: pulumi.Output<string>;

The role that should be applied. Only one gcp.dataproc.JobIAMBinding can be used per role. Note that custom roles must be of the format [projects|organizations]/{parent-name}/roles/{role-name}.

property urn

urn: Output<URN>;

urn is the stable logical URN used to distinctly address a resource, both before and after deployments.

Resource JobIAMMember

class JobIAMMember extends CustomResource

Three different resources help you manage IAM policies on dataproc jobs. Each of these resources serves a different use case:

gcp.dataproc.JobIAMPolicy: Authoritative. Sets the IAM policy for the job and replaces any existing policy already attached.
gcp.dataproc.JobIAMBinding: Authoritative for a given role. Updates the IAM policy to grant a role to a list of members. Other roles within the IAM policy for the job are preserved.
gcp.dataproc.JobIAMMember: Non-authoritative. Updates the IAM policy to grant a role to a new member. Other members for the role for the job are preserved.

Note: gcp.dataproc.JobIAMPolicy cannot be used in conjunction with gcp.dataproc.JobIAMBinding and gcp.dataproc.JobIAMMember or they will fight over what your policy should be. In addition, be careful not to accidentally unset ownership of the job as gcp.dataproc.JobIAMPolicy replaces the entire policy.
Note: gcp.dataproc.JobIAMBinding resources can be used in conjunction with gcp.dataproc.JobIAMMember resources only if they do not grant privilege to the same role.

google_pubsub_subscription_iam_policy

import * as pulumi from "@pulumi/pulumi";
import * as gcp from "@pulumi/gcp";

const admin = gcp.organizations.getIAMPolicy({
    binding: [{
        role: "roles/editor",
        members: ["user:jane@example.com"],
    }],
});
const editor = new gcp.dataproc.JobIAMPolicy("editor", {
    project: "your-project",
    region: "your-region",
    jobId: "your-dataproc-job",
    policyData: admin.then(admin => admin.policyData),
});

google_pubsub_subscription_iam_binding

import * as pulumi from "@pulumi/pulumi";
import * as gcp from "@pulumi/gcp";

const editor = new gcp.dataproc.JobIAMBinding("editor", {
    jobId: "your-dataproc-job",
    members: ["user:jane@example.com"],
    role: "roles/editor",
});

google_pubsub_subscription_iam_member

import * as pulumi from "@pulumi/pulumi";
import * as gcp from "@pulumi/gcp";

const editor = new gcp.dataproc.JobIAMMember("editor", {
    jobId: "your-dataproc-job",
    member: "user:jane@example.com",
    role: "roles/editor",
});

constructor

new JobIAMMember(name: string, args: JobIAMMemberArgs, opts?: pulumi.CustomResourceOptions)

Create a JobIAMMember resource with the given unique name, arguments, and options.

name The unique name of the resource.
args The arguments to use to populate this resource's properties.
opts A bag of options that control this resource's behavior.

method get

public static get(name: string, id: pulumi.Input<pulumi.ID>, state?: JobIAMMemberState, opts?: pulumi.CustomResourceOptions): JobIAMMember

Get an existing JobIAMMember resource’s state with the given name, ID, and optional extra properties used to qualify the lookup.

method getProvider

getProvider(moduleMember: string): ProviderResource | undefined

method isInstance

public static isInstance(obj: any): obj is JobIAMMember

Returns true if the given object is an instance of JobIAMMember. This is designed to work even when multiple copies of the Pulumi SDK have been loaded into the same process.

property condition

public condition: pulumi.Output<JobIAMMemberCondition | undefined>;

property etag

public etag: pulumi.Output<string>;

(Computed) The etag of the jobs’s IAM policy.

property id

id: Output<ID>;

id is the provider-assigned unique ID for this managed resource. It is set during deployments and may be missing (undefined) during planning phases.

property jobId

public jobId: pulumi.Output<string>;

property member

public member: pulumi.Output<string>;

property project

public project: pulumi.Output<string>;

The project in which the job belongs. If it is not provided, the provider will use a default.

property region

public region: pulumi.Output<string>;

The region in which the job belongs. If it is not provided, the provider will use a default.

property role

public role: pulumi.Output<string>;

The role that should be applied. Only one gcp.dataproc.JobIAMBinding can be used per role. Note that custom roles must be of the format [projects|organizations]/{parent-name}/roles/{role-name}.

property urn

urn: Output<URN>;

urn is the stable logical URN used to distinctly address a resource, both before and after deployments.

Resource JobIAMPolicy

class JobIAMPolicy extends CustomResource

Three different resources help you manage IAM policies on dataproc jobs. Each of these resources serves a different use case:

gcp.dataproc.JobIAMPolicy: Authoritative. Sets the IAM policy for the job and replaces any existing policy already attached.
gcp.dataproc.JobIAMBinding: Authoritative for a given role. Updates the IAM policy to grant a role to a list of members. Other roles within the IAM policy for the job are preserved.
gcp.dataproc.JobIAMMember: Non-authoritative. Updates the IAM policy to grant a role to a new member. Other members for the role for the job are preserved.

Note: gcp.dataproc.JobIAMPolicy cannot be used in conjunction with gcp.dataproc.JobIAMBinding and gcp.dataproc.JobIAMMember or they will fight over what your policy should be. In addition, be careful not to accidentally unset ownership of the job as gcp.dataproc.JobIAMPolicy replaces the entire policy.
Note: gcp.dataproc.JobIAMBinding resources can be used in conjunction with gcp.dataproc.JobIAMMember resources only if they do not grant privilege to the same role.

google_pubsub_subscription_iam_policy

import * as pulumi from "@pulumi/pulumi";
import * as gcp from "@pulumi/gcp";

const admin = gcp.organizations.getIAMPolicy({
    binding: [{
        role: "roles/editor",
        members: ["user:jane@example.com"],
    }],
});
const editor = new gcp.dataproc.JobIAMPolicy("editor", {
    project: "your-project",
    region: "your-region",
    jobId: "your-dataproc-job",
    policyData: admin.then(admin => admin.policyData),
});

google_pubsub_subscription_iam_binding

import * as pulumi from "@pulumi/pulumi";
import * as gcp from "@pulumi/gcp";

const editor = new gcp.dataproc.JobIAMBinding("editor", {
    jobId: "your-dataproc-job",
    members: ["user:jane@example.com"],
    role: "roles/editor",
});

google_pubsub_subscription_iam_member

import * as pulumi from "@pulumi/pulumi";
import * as gcp from "@pulumi/gcp";

const editor = new gcp.dataproc.JobIAMMember("editor", {
    jobId: "your-dataproc-job",
    member: "user:jane@example.com",
    role: "roles/editor",
});

constructor

new JobIAMPolicy(name: string, args: JobIAMPolicyArgs, opts?: pulumi.CustomResourceOptions)

Create a JobIAMPolicy resource with the given unique name, arguments, and options.

name The unique name of the resource.
args The arguments to use to populate this resource's properties.
opts A bag of options that control this resource's behavior.

method get

public static get(name: string, id: pulumi.Input<pulumi.ID>, state?: JobIAMPolicyState, opts?: pulumi.CustomResourceOptions): JobIAMPolicy

Get an existing JobIAMPolicy resource’s state with the given name, ID, and optional extra properties used to qualify the lookup.

method getProvider

getProvider(moduleMember: string): ProviderResource | undefined

method isInstance

public static isInstance(obj: any): obj is JobIAMPolicy

Returns true if the given object is an instance of JobIAMPolicy. This is designed to work even when multiple copies of the Pulumi SDK have been loaded into the same process.

property etag

public etag: pulumi.Output<string>;

(Computed) The etag of the jobs’s IAM policy.

property id

id: Output<ID>;

id is the provider-assigned unique ID for this managed resource. It is set during deployments and may be missing (undefined) during planning phases.

property jobId

public jobId: pulumi.Output<string>;

property policyData

public policyData: pulumi.Output<string>;

The policy data generated by a gcp.organizations.getIAMPolicy data source.

property project

public project: pulumi.Output<string>;

The project in which the job belongs. If it is not provided, the provider will use a default.

property region

public region: pulumi.Output<string>;

The region in which the job belongs. If it is not provided, the provider will use a default.

property urn

urn: Output<URN>;

urn is the stable logical URN used to distinctly address a resource, both before and after deployments.

Others

interface AutoscalingPolicyArgs

interface AutoscalingPolicyArgs

The set of arguments for constructing a AutoscalingPolicy resource.

property basicAlgorithm

basicAlgorithm?: pulumi.Input<AutoscalingPolicyBasicAlgorithm>;

Basic algorithm for autoscaling. Structure is documented below.

property location

location?: pulumi.Input<string>;

The location where the autoscaling poicy should reside. The default value is global.

property policyId

policyId: pulumi.Input<string>;

property project

project?: pulumi.Input<string>;

The ID of the project in which the resource belongs. If it is not provided, the provider project is used.

property secondaryWorkerConfig

secondaryWorkerConfig?: pulumi.Input<AutoscalingPolicySecondaryWorkerConfig>;

Describes how the autoscaler will operate for secondary workers. Structure is documented below.

property workerConfig

workerConfig?: pulumi.Input<AutoscalingPolicyWorkerConfig>;

Describes how the autoscaler will operate for primary workers. Structure is documented below.

interface AutoscalingPolicyState

interface AutoscalingPolicyState

Input properties used for looking up and filtering AutoscalingPolicy resources.

property basicAlgorithm

basicAlgorithm?: pulumi.Input<AutoscalingPolicyBasicAlgorithm>;

Basic algorithm for autoscaling. Structure is documented below.

property location

location?: pulumi.Input<string>;

The location where the autoscaling poicy should reside. The default value is global.

property name

name?: pulumi.Input<string>;

The “resource name” of the autoscaling policy.

property policyId

policyId?: pulumi.Input<string>;

property project

project?: pulumi.Input<string>;

The ID of the project in which the resource belongs. If it is not provided, the provider project is used.

property secondaryWorkerConfig

secondaryWorkerConfig?: pulumi.Input<AutoscalingPolicySecondaryWorkerConfig>;

Describes how the autoscaler will operate for secondary workers. Structure is documented below.

property workerConfig

workerConfig?: pulumi.Input<AutoscalingPolicyWorkerConfig>;

Describes how the autoscaler will operate for primary workers. Structure is documented below.

interface ClusterArgs

interface ClusterArgs

The set of arguments for constructing a Cluster resource.

property clusterConfig

clusterConfig?: pulumi.Input<ClusterClusterConfig>;

Allows you to configure various aspects of the cluster. Structure defined below.

property labels

labels?: pulumi.Input<{[key: string]: pulumi.Input<string>}>;

The list of labels (key/value pairs) to be applied to instances in the cluster. GCP generates some itself including goog-dataproc-cluster-name which is the name of the cluster.

property name

name?: pulumi.Input<string>;

The name of the cluster, unique within the project and zone.

property project

project?: pulumi.Input<string>;

The ID of the project in which the cluster will exist. If it is not provided, the provider project is used.

property region

region?: pulumi.Input<string>;

The region in which the cluster and associated nodes will be created in. Defaults to global.

interface ClusterIAMBindingArgs

interface ClusterIAMBindingArgs

The set of arguments for constructing a ClusterIAMBinding resource.

property cluster

cluster: pulumi.Input<string>;

The name or relative resource id of the cluster to manage IAM policies for.

property condition

condition?: pulumi.Input<ClusterIAMBindingCondition>;

property members

members: pulumi.Input<pulumi.Input<string>[]>;

property project

project?: pulumi.Input<string>;

The project in which the cluster belongs. If it is not provided, the provider will use a default.

property region

region?: pulumi.Input<string>;

The region in which the cluster belongs. If it is not provided, the provider will use a default.

property role

role: pulumi.Input<string>;

interface ClusterIAMBindingState

interface ClusterIAMBindingState

Input properties used for looking up and filtering ClusterIAMBinding resources.

property cluster

cluster?: pulumi.Input<string>;

The name or relative resource id of the cluster to manage IAM policies for.

property condition

condition?: pulumi.Input<ClusterIAMBindingCondition>;

property etag

etag?: pulumi.Input<string>;

(Computed) The etag of the clusters’s IAM policy.

property members

members?: pulumi.Input<pulumi.Input<string>[]>;

property project

project?: pulumi.Input<string>;

The project in which the cluster belongs. If it is not provided, the provider will use a default.

property region

region?: pulumi.Input<string>;

The region in which the cluster belongs. If it is not provided, the provider will use a default.

property role

role?: pulumi.Input<string>;

interface ClusterIAMMemberArgs

interface ClusterIAMMemberArgs

The set of arguments for constructing a ClusterIAMMember resource.

property cluster

cluster: pulumi.Input<string>;

The name or relative resource id of the cluster to manage IAM policies for.

property condition

condition?: pulumi.Input<ClusterIAMMemberCondition>;

property member

member: pulumi.Input<string>;

property project

project?: pulumi.Input<string>;

The project in which the cluster belongs. If it is not provided, the provider will use a default.

property region

region?: pulumi.Input<string>;

The region in which the cluster belongs. If it is not provided, the provider will use a default.

property role

role: pulumi.Input<string>;

interface ClusterIAMMemberState

interface ClusterIAMMemberState

Input properties used for looking up and filtering ClusterIAMMember resources.

property cluster

cluster?: pulumi.Input<string>;

The name or relative resource id of the cluster to manage IAM policies for.

property condition

condition?: pulumi.Input<ClusterIAMMemberCondition>;

property etag

etag?: pulumi.Input<string>;

(Computed) The etag of the clusters’s IAM policy.

property member

member?: pulumi.Input<string>;

property project

project?: pulumi.Input<string>;

The project in which the cluster belongs. If it is not provided, the provider will use a default.

property region

region?: pulumi.Input<string>;

The region in which the cluster belongs. If it is not provided, the provider will use a default.

property role

role?: pulumi.Input<string>;

interface ClusterIAMPolicyArgs

interface ClusterIAMPolicyArgs

The set of arguments for constructing a ClusterIAMPolicy resource.

property cluster

cluster: pulumi.Input<string>;

The name or relative resource id of the cluster to manage IAM policies for.

property policyData

policyData: pulumi.Input<string>;

The policy data generated by a gcp.organizations.getIAMPolicy data source.

property project

project?: pulumi.Input<string>;

The project in which the cluster belongs. If it is not provided, the provider will use a default.

property region

region?: pulumi.Input<string>;

The region in which the cluster belongs. If it is not provided, the provider will use a default.

interface ClusterIAMPolicyState

interface ClusterIAMPolicyState

Input properties used for looking up and filtering ClusterIAMPolicy resources.

property cluster

cluster?: pulumi.Input<string>;

The name or relative resource id of the cluster to manage IAM policies for.

property etag

etag?: pulumi.Input<string>;

(Computed) The etag of the clusters’s IAM policy.

property policyData

policyData?: pulumi.Input<string>;

The policy data generated by a gcp.organizations.getIAMPolicy data source.

property project

project?: pulumi.Input<string>;

The project in which the cluster belongs. If it is not provided, the provider will use a default.

property region

region?: pulumi.Input<string>;

The region in which the cluster belongs. If it is not provided, the provider will use a default.

interface ClusterState

interface ClusterState

Input properties used for looking up and filtering Cluster resources.

property clusterConfig

clusterConfig?: pulumi.Input<ClusterClusterConfig>;

Allows you to configure various aspects of the cluster. Structure defined below.

property labels

labels?: pulumi.Input<{[key: string]: pulumi.Input<string>}>;

The list of labels (key/value pairs) to be applied to instances in the cluster. GCP generates some itself including goog-dataproc-cluster-name which is the name of the cluster.

property name

name?: pulumi.Input<string>;

The name of the cluster, unique within the project and zone.

property project

project?: pulumi.Input<string>;

The ID of the project in which the cluster will exist. If it is not provided, the provider project is used.

property region

region?: pulumi.Input<string>;

The region in which the cluster and associated nodes will be created in. Defaults to global.

interface JobArgs

interface JobArgs

The set of arguments for constructing a Job resource.

property forceDelete

forceDelete?: pulumi.Input<boolean>;

By default, you can only delete inactive jobs within Dataproc. Setting this to true, and calling destroy, will ensure that the job is first cancelled before issuing the delete.

property hadoopConfig

hadoopConfig?: pulumi.Input<JobHadoopConfig>;

property hiveConfig

hiveConfig?: pulumi.Input<JobHiveConfig>;

property labels

labels?: pulumi.Input<{[key: string]: pulumi.Input<string>}>;

The list of labels (key/value pairs) to add to the job.

property pigConfig

pigConfig?: pulumi.Input<JobPigConfig>;

property placement

placement: pulumi.Input<JobPlacement>;

property project

project?: pulumi.Input<string>;

The project in which the cluster can be found and jobs subsequently run against. If it is not provided, the provider project is used.

property pysparkConfig

pysparkConfig?: pulumi.Input<JobPysparkConfig>;

property reference

reference?: pulumi.Input<JobReference>;

property region

region?: pulumi.Input<string>;

The Cloud Dataproc region. This essentially determines which clusters are available for this job to be submitted to. If not specified, defaults to global.

property scheduling

scheduling?: pulumi.Input<JobScheduling>;

Optional. Job scheduling configuration.

property sparkConfig

sparkConfig?: pulumi.Input<JobSparkConfig>;

property sparksqlConfig

sparksqlConfig?: pulumi.Input<JobSparksqlConfig>;

interface JobIAMBindingArgs

interface JobIAMBindingArgs

The set of arguments for constructing a JobIAMBinding resource.

property condition

condition?: pulumi.Input<JobIAMBindingCondition>;

property jobId

jobId: pulumi.Input<string>;

property members

members: pulumi.Input<pulumi.Input<string>[]>;

property project

project?: pulumi.Input<string>;

The project in which the job belongs. If it is not provided, the provider will use a default.

property region

region?: pulumi.Input<string>;

The region in which the job belongs. If it is not provided, the provider will use a default.

property role

role: pulumi.Input<string>;

The role that should be applied. Only one gcp.dataproc.JobIAMBinding can be used per role. Note that custom roles must be of the format [projects|organizations]/{parent-name}/roles/{role-name}.

interface JobIAMBindingState

interface JobIAMBindingState

Input properties used for looking up and filtering JobIAMBinding resources.

property condition

condition?: pulumi.Input<JobIAMBindingCondition>;

property etag

etag?: pulumi.Input<string>;

(Computed) The etag of the jobs’s IAM policy.

property jobId

jobId?: pulumi.Input<string>;

property members

members?: pulumi.Input<pulumi.Input<string>[]>;

property project

project?: pulumi.Input<string>;

The project in which the job belongs. If it is not provided, the provider will use a default.

property region

region?: pulumi.Input<string>;

The region in which the job belongs. If it is not provided, the provider will use a default.

property role

role?: pulumi.Input<string>;

The role that should be applied. Only one gcp.dataproc.JobIAMBinding can be used per role. Note that custom roles must be of the format [projects|organizations]/{parent-name}/roles/{role-name}.

interface JobIAMMemberArgs

interface JobIAMMemberArgs

The set of arguments for constructing a JobIAMMember resource.

property condition

condition?: pulumi.Input<JobIAMMemberCondition>;

property jobId

jobId: pulumi.Input<string>;

property member

member: pulumi.Input<string>;

property project

project?: pulumi.Input<string>;

The project in which the job belongs. If it is not provided, the provider will use a default.

property region

region?: pulumi.Input<string>;

The region in which the job belongs. If it is not provided, the provider will use a default.

property role

role: pulumi.Input<string>;

The role that should be applied. Only one gcp.dataproc.JobIAMBinding can be used per role. Note that custom roles must be of the format [projects|organizations]/{parent-name}/roles/{role-name}.

interface JobIAMMemberState

interface JobIAMMemberState

Input properties used for looking up and filtering JobIAMMember resources.

property condition

condition?: pulumi.Input<JobIAMMemberCondition>;

property etag

etag?: pulumi.Input<string>;

(Computed) The etag of the jobs’s IAM policy.

property jobId

jobId?: pulumi.Input<string>;

property member

member?: pulumi.Input<string>;

property project

project?: pulumi.Input<string>;

The project in which the job belongs. If it is not provided, the provider will use a default.

property region

region?: pulumi.Input<string>;

The region in which the job belongs. If it is not provided, the provider will use a default.

property role

role?: pulumi.Input<string>;

The role that should be applied. Only one gcp.dataproc.JobIAMBinding can be used per role. Note that custom roles must be of the format [projects|organizations]/{parent-name}/roles/{role-name}.

interface JobIAMPolicyArgs

interface JobIAMPolicyArgs

The set of arguments for constructing a JobIAMPolicy resource.

property jobId

jobId: pulumi.Input<string>;

property policyData

policyData: pulumi.Input<string>;

The policy data generated by a gcp.organizations.getIAMPolicy data source.

property project

project?: pulumi.Input<string>;

The project in which the job belongs. If it is not provided, the provider will use a default.

property region

region?: pulumi.Input<string>;

The region in which the job belongs. If it is not provided, the provider will use a default.

interface JobIAMPolicyState

interface JobIAMPolicyState

Input properties used for looking up and filtering JobIAMPolicy resources.

property etag

etag?: pulumi.Input<string>;

(Computed) The etag of the jobs’s IAM policy.

property jobId

jobId?: pulumi.Input<string>;

property policyData

policyData?: pulumi.Input<string>;

The policy data generated by a gcp.organizations.getIAMPolicy data source.

property project

project?: pulumi.Input<string>;

The project in which the job belongs. If it is not provided, the provider will use a default.

property region

region?: pulumi.Input<string>;

The region in which the job belongs. If it is not provided, the provider will use a default.

interface JobState

interface JobState

Input properties used for looking up and filtering Job resources.

property driverControlsFilesUri

driverControlsFilesUri?: pulumi.Input<string>;

If present, the location of miscellaneous control files which may be used as part of job setup and handling. If not present, control files may be placed in the same location as driver_output_uri.

property driverOutputResourceUri

driverOutputResourceUri?: pulumi.Input<string>;

A URI pointing to the location of the stdout of the job’s driver program.

property forceDelete

forceDelete?: pulumi.Input<boolean>;

By default, you can only delete inactive jobs within Dataproc. Setting this to true, and calling destroy, will ensure that the job is first cancelled before issuing the delete.

property hadoopConfig

hadoopConfig?: pulumi.Input<JobHadoopConfig>;

property hiveConfig

hiveConfig?: pulumi.Input<JobHiveConfig>;

property labels

labels?: pulumi.Input<{[key: string]: pulumi.Input<string>}>;

The list of labels (key/value pairs) to add to the job.

property pigConfig

pigConfig?: pulumi.Input<JobPigConfig>;

property placement

placement?: pulumi.Input<JobPlacement>;

property project

project?: pulumi.Input<string>;

The project in which the cluster can be found and jobs subsequently run against. If it is not provided, the provider project is used.

property pysparkConfig

pysparkConfig?: pulumi.Input<JobPysparkConfig>;

property reference

reference?: pulumi.Input<JobReference>;

property region

region?: pulumi.Input<string>;

The Cloud Dataproc region. This essentially determines which clusters are available for this job to be submitted to. If not specified, defaults to global.

property scheduling

scheduling?: pulumi.Input<JobScheduling>;

Optional. Job scheduling configuration.

property sparkConfig

sparkConfig?: pulumi.Input<JobSparkConfig>;

property sparksqlConfig

sparksqlConfig?: pulumi.Input<JobSparksqlConfig>;

property status

status?: pulumi.Input<JobStatus>;

The Pulumi Platform

Get Started

Migrate to Pulumi

Solutions for All Teams and Engineers

Any Code

Any Cloud

Module dataproc

Resources

Others

Resources

Example Usage - Dataproc Autoscaling Policy

Example Usage - Basic

Example Usage - Advanced

Example Usage - Using a GPU accelerator

google_pubsub_subscription_iam_policy

google_pubsub_subscription_iam_binding

google_pubsub_subscription_iam_member

google_pubsub_subscription_iam_policy

google_pubsub_subscription_iam_binding

google_pubsub_subscription_iam_member

google_pubsub_subscription_iam_policy

google_pubsub_subscription_iam_binding

google_pubsub_subscription_iam_member

google_pubsub_subscription_iam_policy

google_pubsub_subscription_iam_binding

google_pubsub_subscription_iam_member

google_pubsub_subscription_iam_policy

google_pubsub_subscription_iam_binding

google_pubsub_subscription_iam_member

google_pubsub_subscription_iam_policy

google_pubsub_subscription_iam_binding

google_pubsub_subscription_iam_member