Beam Window
Description
The Beam Window transform adds event-time-based window functions using the Beam execution engine.
Options
Option | Description |
---|---|
Transform name | Name of the transform, this name has to be unique in a single pipeline. |
Window type |
|
Window size (duration in seconds) | Sets the window duration size in seconds, default 60. |
Every x seconds (Sliding windows) | Sets the slide window duration in seconds. |
Window start field | The field containing the window start time. |
Window end field | The field containing the window end time. |
Window max field | The field containing the max duration between events. |
Window Types
Fixed
Fixed or tumbling windows are used to repeatedly segment data into distinct time segments and do not overlap. Events cannot belong to more than one window.
Sliding
Sliding windows produce an output only when an event occurs and continuously move forward. Every window will have at least one event and can overlap. Events can belong to more than one window.
Session
Session windows group events which arrive at similar times and filter out periods of time when there is no data.
The window begins when the first event occurs and extends to include new events within a specified timeout. If events keep occurring the window will keep extending until maximum duration is reached.