Avro Decode

Description

The Avro Decode transform allows you to decode an Avro field and convert it to Hop fields.

Options

Option
Description
Transform name
Name of the transform. Note: This name has to be unique in a single pipeline.
Source field
Select the name of the field (of type: Avro) to convert
Source fields
You can specify the names of the Avro fields to select from the Avro records. You can also specify to which Hop data type you want to convert to. Please note that complex data types like Map and Record are converted into JSON which you can then parse further in subsequent transforms. Note: The "Avro type" column is informational only. It’s not used at runtime.
Get fields button
You can use the "Get fields" button to retrieve the fields from the schema present in the metadata of the specified Avro Record source field. If there’s no metadata in this field, in case of sourcing from a Kafka consumer for example, you can opt to read from an Avro file.

Option

Description

Transform name

Name of the transform. Note: This name has to be unique in a single pipeline.

Source field

Select the name of the field (of type: Avro) to convert

Source fields

You can specify the names of the Avro fields to select from the Avro records. You can also specify to which Hop data type you want to convert to. Please note that complex data types like Map and Record are converted into JSON which you can then parse further in subsequent transforms. Note: The "Avro type" column is informational only. It’s not used at runtime.

Get fields button

You can use the "Get fields" button to retrieve the fields from the schema present in the metadata of the specified Avro Record source field. If there’s no metadata in this field, in case of sourcing from a Kafka consumer for example, you can opt to read from an Avro file.

Metadata Injection Support

All fields of this transform support metadata injection.