Append Streams Icon Append Streams

Description

The Append Streams transform reads the data from two transforms, only processing the second stream after the first one is finished.

As always, the row layout for the input data coming from both transforms has to be identical: the same row lengths, the same data types, the same fields at the same field indexes in the row.

Important: If you don’t care about the order in which the output rows occur, you can use any transform to create a union of 2 or more data streams.

Supported Engines

Hop Engine

Supported

Spark

Not Supported

Flink

Not Supported

Dataflow

Not Supported

Options

Option Description

Transform name

Name of the transform. Note: This name has to be unique in a single pipeline.

Head hop

The name of the transform from which will be read the first stream.

Tail hop

The name of the transform from which will be read the second stream.

Metadata Injection Support

All fields of this transform support metadata injection.