Workflow Log
Description
Allows to log the activity of a workflow with a pipeline.
A workflow log streams logging information from a running workflow to a pipeline.
The only requirement for the receiving pipeline is that it starts with a Workflow Logging transform. Other than that, the logging pipeline is "just another pipeline". In this logging pipeline, you can process the logging information and e.g. write to a relational or NoSQL database, a Kafka topic etc
Samples
The samples project comes with an example workflow log.
Check the metadata perspective for the workflow log workflow-log-example. This workflow log is configured to send logging information for the workflow ${PROJECT_HOME}/reflection/generate-fake-books.hwf to the logging pipeline ${PROJECT_HOME}/reflection/workflow-log-example.hpl.
Options
| Option | Default | Description |
|---|---|---|
Name |
The name to be used for this workflow log |
|
Enabled? |
true |
|
Logging parent workflow only |
true |
|
Pipeline executed to capture logging |
the pipeline to process the logging information for this workflow log |
|
Execute at the start of the workflow? |
true |
Should this workflow log be executed at the start of a workflow run |
Execute at the end of the workflow? |
false |
Should this workflow log be executed at the end of a workflow run |
Execute periodically during execution? |
true |
Should this workflow log be executed periodically during a workflow run |
Interval in seconds |
30 |
if executed periodically, indicates the interval at which the workflow log is executed |