Partition Schema
Description
Describes a partition schema. A partition schema defines how many ways the row stream will be split. The names used for the partitions can be anything you like.
The schema is used only by the local Hop pipeline engine, including when a Hop Server runs that engine. Beam engines (Flink, Spark, Dataflow and Direct) and the native Spark engine ignore it. See Partitioning.
Related Plugins
None/All
Options
| Option | Default | Description |
|---|---|---|
Partition schema name |
The name to be used for this partition schema |
|
Dynamically create the schema definition |
? |
|
Number of partitions? |
4 |
|
Partitions |
list of partition IDs |
Samples (Integration Tests)
-
integration-tests/partitioning/0006-partitioned-when-stream-lookup-should-fail2.hpl
-
integration-tests/partitioning/0004-copies-repartitioning.hpl
-
integration-tests/partitioning/0001-static-partitioning.hpl
-
integration-tests/partitioning/0005-partitioned-stream-lookup.hpl
-
integration-tests/partitioning/0006-partitioned-when-stream-lookup-should-fail.hpl
-
integration-tests/partitioning/0003-repartitioning.hpl
-
integration-tests/partitioning/0005-non-partitioned-stream-lookup.hpl
-
integration-tests/partitioning/0002-dynamic-partitioning.hpl