Output transform metrics Icon Output transform metrics

Description

Output transform metrics waits until the listed transform copies in the same pipeline have finished, then emits one output row per watched copy with the requested counters.

This transform is a row generator. It does not consume incoming rows and must not have incoming hops. Connecting an upstream hop can deadlock the pipeline: the watched transform cannot finish while its output buffer is full, and this transform never drains that buffer.

Use this transform when a pipeline itself needs metrics (for example after a Kettle/PDI import, or to feed Write to log). For project-wide monitoring, prefer Pipeline logging or Execution information.

Supported Engines

Hop Engine

Supported

Single Threaded

Not Supported

Native Spark

Not Supported

Beam Spark

Not Supported

Beam Flink

Not Supported

Beam Dataflow

Not Supported

Options

Transforms

Output transform metrics Transforms tab

Option Description

Transform name

Name of this transform.

Metrics for the following transforms

The transform copies to wait for. You cannot watch this transform itself or a downstream target of it.

Get Fields

Fill the grid with every other transform that is not a downstream target.
Column Description

Transform name

Name of the transform to watch.

Copy Nr

0-based copy number. Use one grid row per copy if the transform runs multiple copies. Variables are allowed.

Required

When Yes, the pipeline fails if that copy cannot be found. When No, a missing copy is skipped.

Fields

Output transform metrics Fields tab

Leave a field name empty to omit that column from the output.

Option Description

Transform name

Name of the watched transform.

Transform id

Plugin id of the watched transform.

Lines input

Rows read from an external source.

Lines output

Rows written to an external destination.

Lines read

Rows read from previous transforms.

Lines updated

Rows updated.

Lines written

Rows written to the next transforms.

Lines rejected

Rows sent to an error hop (getLinesRejected()). This is not the error count.

Duration (ms)

Execution duration in milliseconds.

Kettle / PDI import

Kettle called this transform Output steps metrics (StepsMetrics). Hop import rewrites the plugin type to TransformsMetrics and the XML tags from step* to transform*. Stored values of output field names (for example Step name) are left unchanged so existing pipelines keep their column names.