Class Job

Manages a job resource within a Dataproc cluster within GCE. For more information see the official dataproc documentation.

!> Note: This resource does not support 'update' and changing any attributes will cause the resource to be recreated.

Inheritance
System.Object
Resource
CustomResource
Job
Inherited Members
System.Object.Equals(System.Object)
System.Object.Equals(System.Object, System.Object)
System.Object.GetHashCode()
System.Object.GetType()
System.Object.MemberwiseClone()
System.Object.ReferenceEquals(System.Object, System.Object)
System.Object.ToString()
Namespace: Pulumi.Gcp.Dataproc
Assembly: Pulumi.Gcp.dll
Syntax
public class Job : CustomResource

Constructors

View Source

Job(String, JobArgs, CustomResourceOptions)

Create a Job resource with the given unique name, arguments, and options.

Declaration
public Job(string name, JobArgs args, CustomResourceOptions options = null)
Parameters
Type Name Description
System.String name

The unique name of the resource
JobArgs args

The arguments used to populate this resource's properties
CustomResourceOptions options

A bag of options that control this resource's behavior

Properties

View Source

DriverControlsFilesUri

If present, the location of miscellaneous control files which may be used as part of job setup and handling. If not present, control files may be placed in the same location as driver_output_uri.

Declaration
public Output<string> DriverControlsFilesUri { get; }
Property Value
Type Description
Output<System.String>
View Source

DriverOutputResourceUri

A URI pointing to the location of the stdout of the job's driver program.

Declaration
public Output<string> DriverOutputResourceUri { get; }
Property Value
Type Description
Output<System.String>
View Source

ForceDelete

By default, you can only delete inactive jobs within Dataproc. Setting this to true, and calling destroy, will ensure that the job is first cancelled before issuing the delete.

Declaration
public Output<bool?> ForceDelete { get; }
Property Value
Type Description
Output<System.Nullable<System.Boolean>>
View Source

HadoopConfig

Declaration
public Output<JobHadoopConfig> HadoopConfig { get; }
Property Value
Type Description
Output<JobHadoopConfig>
View Source

HiveConfig

Declaration
public Output<JobHiveConfig> HiveConfig { get; }
Property Value
Type Description
Output<JobHiveConfig>
View Source

Labels

The list of labels (key/value pairs) to add to the job.

Declaration
public Output<ImmutableDictionary<string, string>> Labels { get; }
Property Value
Type Description
Output<System.Collections.Immutable.ImmutableDictionary<System.String, System.String>>
View Source

PigConfig

Declaration
public Output<JobPigConfig> PigConfig { get; }
Property Value
Type Description
Output<JobPigConfig>
View Source

Placement

Declaration
public Output<JobPlacement> Placement { get; }
Property Value
Type Description
Output<JobPlacement>
View Source

Project

The project in which the cluster can be found and jobs subsequently run against. If it is not provided, the provider project is used.

Declaration
public Output<string> Project { get; }
Property Value
Type Description
Output<System.String>
View Source

PysparkConfig

Declaration
public Output<JobPysparkConfig> PysparkConfig { get; }
Property Value
Type Description
Output<JobPysparkConfig>
View Source

Reference

Declaration
public Output<JobReference> Reference { get; }
Property Value
Type Description
Output<JobReference>
View Source

Region

The Cloud Dataproc region. This essentially determines which clusters are available for this job to be submitted to. If not specified, defaults to global.

Declaration
public Output<string> Region { get; }
Property Value
Type Description
Output<System.String>
View Source

Scheduling

Optional. Job scheduling configuration.

Declaration
public Output<JobScheduling> Scheduling { get; }
Property Value
Type Description
Output<JobScheduling>
View Source

SparkConfig

Declaration
public Output<JobSparkConfig> SparkConfig { get; }
Property Value
Type Description
Output<JobSparkConfig>
View Source

SparksqlConfig

Declaration
public Output<JobSparksqlConfig> SparksqlConfig { get; }
Property Value
Type Description
Output<JobSparksqlConfig>
View Source

Status

Declaration
public Output<JobStatus> Status { get; }
Property Value
Type Description
Output<JobStatus>

Methods

View Source

Get(String, Input<String>, JobState, CustomResourceOptions)

Get an existing Job resource's state with the given name, ID, and optional extra properties used to qualify the lookup.

Declaration
public static Job Get(string name, Input<string> id, JobState state = null, CustomResourceOptions options = null)
Parameters
Type Name Description
System.String name

The unique name of the resulting resource.
Input<System.String> id

The unique provider ID of the resource to lookup.
JobState state

Any extra arguments used during the lookup.
CustomResourceOptions options

A bag of options that control this resource's behavior
Returns
Type Description
Job