Class FirehoseDeliveryStreamExtendedS3Configuration
Inheritance
Inherited Members
Namespace: Pulumi.Aws.Kinesis.Outputs
Assembly: Pulumi.Aws.dll
Syntax
public sealed class FirehoseDeliveryStreamExtendedS3Configuration
Fields
View SourceBucketArn
The ARN of the S3 bucket
Declaration
public readonly string BucketArn
Field Value
| Type | Description |
|---|---|
| System.String |
BufferInterval
Buffer incoming data for the specified period of time, in seconds, before delivering it to the destination. The default value is 300.
Declaration
public readonly int? BufferInterval
Field Value
| Type | Description |
|---|---|
| System.Nullable<System.Int32> |
BufferSize
Buffer incoming data to the specified size, in MBs, before delivering it to the destination. The default value is 5. We recommend setting SizeInMBs to a value greater than the amount of data you typically ingest into the delivery stream in 10 seconds. For example, if you typically ingest data at 1 MB/sec set SizeInMBs to be 10 MB or higher.
Declaration
public readonly int? BufferSize
Field Value
| Type | Description |
|---|---|
| System.Nullable<System.Int32> |
CloudwatchLoggingOptions
The CloudWatch Logging Options for the delivery stream. More details are given below
Declaration
public readonly FirehoseDeliveryStreamExtendedS3ConfigurationCloudwatchLoggingOptions CloudwatchLoggingOptions
Field Value
| Type | Description |
|---|---|
| FirehoseDeliveryStreamExtendedS3ConfigurationCloudwatchLoggingOptions |
CompressionFormat
The compression format. If no value is specified, the default is UNCOMPRESSED. Other supported values are GZIP, ZIP & Snappy. If the destination is redshift you cannot use ZIP or Snappy.
Declaration
public readonly string CompressionFormat
Field Value
| Type | Description |
|---|---|
| System.String |
DataFormatConversionConfiguration
Nested argument for the serializer, deserializer, and schema for converting data from the JSON format to the Parquet or ORC format before writing it to Amazon S3. More details given below.
Declaration
public readonly FirehoseDeliveryStreamExtendedS3ConfigurationDataFormatConversionConfiguration DataFormatConversionConfiguration
Field Value
| Type | Description |
|---|---|
| FirehoseDeliveryStreamExtendedS3ConfigurationDataFormatConversionConfiguration |
ErrorOutputPrefix
Prefix added to failed records before writing them to S3. This prefix appears immediately following the bucket name.
Declaration
public readonly string ErrorOutputPrefix
Field Value
| Type | Description |
|---|---|
| System.String |
KmsKeyArn
Specifies the KMS key ARN the stream will use to encrypt data. If not set, no encryption will be used.
Declaration
public readonly string KmsKeyArn
Field Value
| Type | Description |
|---|---|
| System.String |
Prefix
The "YYYY/MM/DD/HH" time format prefix is automatically used for delivered S3 files. You can specify an extra prefix to be added in front of the time format prefix. Note that if the prefix ends with a slash, it appears as a folder in the S3 bucket
Declaration
public readonly string Prefix
Field Value
| Type | Description |
|---|---|
| System.String |
ProcessingConfiguration
The data processing configuration. More details are given below.
Declaration
public readonly FirehoseDeliveryStreamExtendedS3ConfigurationProcessingConfiguration ProcessingConfiguration
Field Value
| Type | Description |
|---|---|
| FirehoseDeliveryStreamExtendedS3ConfigurationProcessingConfiguration |
RoleArn
The role that Kinesis Data Firehose can use to access AWS Glue. This role must be in the same account you use for Kinesis Data Firehose. Cross-account roles aren't allowed.
Declaration
public readonly string RoleArn
Field Value
| Type | Description |
|---|---|
| System.String |
S3BackupConfiguration
The configuration for backup in Amazon S3. Required if s3_backup_mode is Enabled. Supports the same fields as s3_configuration object.
Declaration
public readonly FirehoseDeliveryStreamExtendedS3ConfigurationS3BackupConfiguration S3BackupConfiguration
Field Value
| Type | Description |
|---|---|
| FirehoseDeliveryStreamExtendedS3ConfigurationS3BackupConfiguration |
S3BackupMode
The Amazon S3 backup mode. Valid values are Disabled and Enabled. Default value is Disabled.
Declaration
public readonly string S3BackupMode
Field Value
| Type | Description |
|---|---|
| System.String |