Class FirehoseDeliveryStreamExtendedS3ConfigurationDataFormatConversionConfigurationOutputFormatConfigurationSerializerOrcSerDeGetArgs

Inheritance

System.Object

InputArgs

ResourceArgs

FirehoseDeliveryStreamExtendedS3ConfigurationDataFormatConversionConfigurationOutputFormatConfigurationSerializerOrcSerDeGetArgs

Inherited Members

ResourceArgs.Empty

System.Object.Equals(System.Object)

System.Object.Equals(System.Object, System.Object)

System.Object.GetHashCode()

System.Object.GetType()

System.Object.MemberwiseClone()

System.Object.ReferenceEquals(System.Object, System.Object)

System.Object.ToString()

Namespace: Pulumi.Aws.Kinesis.Inputs

Assembly: Pulumi.Aws.dll

Syntax

public sealed class FirehoseDeliveryStreamExtendedS3ConfigurationDataFormatConversionConfigurationOutputFormatConfigurationSerializerOrcSerDeGetArgs : ResourceArgs

Constructors

FirehoseDeliveryStreamExtendedS3ConfigurationDataFormatConversionConfigurationOutputFormatConfigurationSerializerOrcSerDeGetArgs()

Declaration

public FirehoseDeliveryStreamExtendedS3ConfigurationDataFormatConversionConfigurationOutputFormatConfigurationSerializerOrcSerDeGetArgs()

Properties

BlockSizeBytes

The Hadoop Distributed File System (HDFS) block size. This is useful if you intend to copy the data from Amazon S3 to HDFS before querying. The default is 256 MiB and the minimum is 64 MiB. Kinesis Data Firehose uses this value for padding calculations.

Declaration

public Input<int> BlockSizeBytes { get; set; }

Property Value

Type	Description
Input<System.Int32>

BloomFilterColumns

A list of column names for which you want Kinesis Data Firehose to create bloom filters.

Declaration

public InputList<string> BloomFilterColumns { get; set; }

Property Value

Type	Description
InputList<System.String>

BloomFilterFalsePositiveProbability

The Bloom filter false positive probability (FPP). The lower the FPP, the bigger the Bloom filter. The default value is 0.05, the minimum is 0, and the maximum is 1.

Declaration

public Input<double> BloomFilterFalsePositiveProbability { get; set; }

Property Value

Type	Description
Input<System.Double>

Compression

The compression code to use over data blocks. The possible values are UNCOMPRESSED, SNAPPY, and GZIP, with the default being SNAPPY. Use SNAPPY for higher decompression speed. Use GZIP if the compression ratio is more important than speed.

Declaration

public Input<string> Compression { get; set; }

Property Value

Type	Description
Input<System.String>

DictionaryKeyThreshold

A float that represents the fraction of the total number of non-null rows. To turn off dictionary encoding, set this fraction to a number that is less than the number of distinct keys in a dictionary. To always use dictionary encoding, set this threshold to 1.

Declaration

public Input<double> DictionaryKeyThreshold { get; set; }

Property Value

Type	Description
Input<System.Double>

EnablePadding

Set this to true to indicate that you want stripes to be padded to the HDFS block boundaries. This is useful if you intend to copy the data from Amazon S3 to HDFS before querying. The default is false.

Declaration

public Input<bool> EnablePadding { get; set; }

Property Value

Type	Description
Input<System.Boolean>

FormatVersion

The version of the file to write. The possible values are V0_11 and V0_12. The default is V0_12.

Declaration

public Input<string> FormatVersion { get; set; }

Property Value

Type	Description
Input<System.String>

PaddingTolerance

A float between 0 and 1 that defines the tolerance for block padding as a decimal fraction of stripe size. The default value is 0.05, which means 5 percent of stripe size. For the default values of 64 MiB ORC stripes and 256 MiB HDFS blocks, the default block padding tolerance of 5 percent reserves a maximum of 3.2 MiB for padding within the 256 MiB block. In such a case, if the available size within the block is more than 3.2 MiB, a new, smaller stripe is inserted to fit within that space. This ensures that no stripe crosses block boundaries and causes remote reads within a node-local task. Kinesis Data Firehose ignores this parameter when enable_padding is false.

Declaration

public Input<double> PaddingTolerance { get; set; }

Property Value

Type	Description
Input<System.Double>

RowIndexStride

The number of rows between index entries. The default is 10000 and the minimum is 1000.

Declaration

public Input<int> RowIndexStride { get; set; }

Property Value

Type	Description
Input<System.Int32>

StripeSizeBytes

The number of bytes in each stripe. The default is 64 MiB and the minimum is 8 MiB.

Declaration

public Input<int> StripeSizeBytes { get; set; }

Property Value

Type	Description
Input<System.Int32>