Beam File Definition

Description

folder

A Beam File Definition describes a file layout in a Beam pipeline and specifies the file layout (name, field definitions, enclosure and separator) to be used in Beam Pipelines.

Related Plugins

Transforms:

Options

Option Description

Name

The name to be used for this Beam file definition

Description

The description to be used for this Beam file definition

Field Separator

separator used between fields in the file definition

Enclosure

field enclosure used for fields in the file definition

Field Definitions

List of field name, type, format, length and precision. Describes the file layout for this field definition.

Samples

  • beam/pipelines/complex.hpl

  • beam/pipelines/generate-synthetic-data.hpl

  • beam/pipelines/input-process-output.hpl

  • beam/pipelines/switch-case.hpl

  • beam/pipelines/unbounded-synthetic-data.hpl