Class JobHadoopConfig

Inheritance

System.Object

JobHadoopConfig

Inherited Members

System.Object.Equals(System.Object)

System.Object.Equals(System.Object, System.Object)

System.Object.GetHashCode()

System.Object.GetType()

System.Object.MemberwiseClone()

System.Object.ReferenceEquals(System.Object, System.Object)

System.Object.ToString()

Namespace: Pulumi.Gcp.Dataproc.Outputs

Assembly: Pulumi.Gcp.dll

Syntax

public sealed class JobHadoopConfig

Fields

ArchiveUris

HCFS URIs of archives to be extracted in the working directory of .jar, .tar, .tar.gz, .tgz, and .zip.

Declaration

public readonly ImmutableArray<string> ArchiveUris

Field Value

Type	Description
System.Collections.Immutable.ImmutableArray<System.String>

Args

The arguments to pass to the driver. Do not include arguments, such as -libjars or -Dfoo=bar, that can be set as job properties, since a collision may occur that causes an incorrect job submission.

Declaration

public readonly ImmutableArray<string> Args

Field Value

Type	Description
System.Collections.Immutable.ImmutableArray<System.String>

FileUris

HCFS URIs of files to be copied to the working directory of Hadoop drivers and distributed tasks. Useful for naively parallel tasks.

Declaration

public readonly ImmutableArray<string> FileUris

Field Value

Type	Description
System.Collections.Immutable.ImmutableArray<System.String>

JarFileUris

HCFS URIs of jar files to be added to the Spark CLASSPATH.

Declaration

public readonly ImmutableArray<string> JarFileUris

Field Value

Type	Description
System.Collections.Immutable.ImmutableArray<System.String>

LoggingConfig

Declaration

public readonly JobHadoopConfigLoggingConfig LoggingConfig

Field Value

Type	Description
JobHadoopConfigLoggingConfig

MainClass

The name of the driver's main class. The jar file containing the class must be in the default CLASSPATH or specified in jar_file_uris. Conflicts with main_jar_file_uri

Declaration

public readonly string MainClass

Field Value

Type	Description
System.String

MainJarFileUri

The HCFS URI of the jar file containing the main class. Examples: 'gs://foo-bucket/analytics-binaries/extract-useful-metrics-mr.jar' 'hdfs:/tmp/test-samples/custom-wordcount.jar' 'file:///home/usr/lib/hadoop-mapreduce/hadoop-mapreduce-examples.jar'. Conflicts with main_class

Declaration

public readonly string MainJarFileUri

Field Value

Type	Description
System.String

Properties

A mapping of property names to values, used to configure Spark SQL's SparkConf. Properties that conflict with values set by the Cloud Dataproc API may be overwritten.

Declaration

public readonly ImmutableDictionary<string, string> Properties

Field Value

Type	Description
System.Collections.Immutable.ImmutableDictionary<System.String, System.String>