Beam File Definition
Description
A Beam File Definition describes a file layout in a Beam pipeline and specifies the file layout (name, field definitions, enclosure and separator) to be used in Beam Pipelines.
Related Plugins
Transforms:
Options
| Option | Description |
|---|---|
Name |
The name to be used for this Beam file definition |
Description |
The description to be used for this Beam file definition |
Field Separator |
separator used between fields in the file definition |
Enclosure |
field enclosure used for fields in the file definition |
Field Definitions |
List of field name, type, format, length and precision. Describes the file layout for this field definition. |
Samples
-
beam/pipelines/complex.hpl
-
beam/pipelines/generate-synthetic-data.hpl
-
beam/pipelines/input-process-output.hpl
-
beam/pipelines/switch-case.hpl
-
beam/pipelines/unbounded-synthetic-data.hpl