Row Generator transform Icon Row Generator

Description

The Row Generator transform outputs a specified number of rows that are empty or have a set of hard-coded fields.

By default, the rows are empty; however they can contain a number of static fields.

This transform is used primarily for testing purposes.

It may be useful for generating a fixed number of rows, for example, you want exactly 12 rows for 12 months.

Sometimes you may use Generate Rows to generate one row that is an initiating point for your pipeline.

For example, you might generate one row that contains two or three field values that you might use to parameterize your SQL and then generate the real rows.

Supported Engines

Hop Engine

Supported

Spark

Supported

Flink

Supported

Dataflow

Supported

Options

Option Description

Transform Name

Name of the transform this name has to be unique in a single pipeline

Limit

Sets the maximum number of rows you want to generate

Fields

This table is where you configure the structure and values of the rows you are generating (optional).

Never stop generating rows

This option is intended for real-time use cases where you never want to stop the running pipeline. The output of this transform is then used to drive recurring tasks like polling from a file, queue, database, …​

Interval in ms

The interval between generated rows in milliseconds.

Current row time field name

The *optional *field name for the Date field containing the time when the current row was generated

Previous row time field name

The *optional *field name for the Date field containing the time when the previous row was generated