Kafka producer

Transform name

the name for this transform

Bootstrap servers

comma separated list of bootstrap servers in a Kafka cluster

Client ID

The unique Client identifier, used to identify and set up a durable connection path to the server to make requests and to distinguish between different clients.

Topic

The category to which records are published. Disabled when the topic is read from a field.

Get topic from field

Read the topic from a field in the incoming stream instead of publishing every row to a fixed topic. This lets a single transform route rows across topics, rather than needing one Kafka producer transform per topic.

Topic field

The field holding the topic name for each row, used when Get topic from field is enabled. Rows where this field is empty cause the transform to fail.

Headers field

Optional. A field holding the record headers to attach to each message, as a JSON array of {"name":..,"value":..} objects — the same shape the Kafka Consumer transform produces, so headers survive a consume-then-produce round trip. An array is used rather than a JSON object because Kafka keeps headers ordered and allows a name to repeat. Leave empty to send messages without headers.

Key Field

In Kafka, all messages can be keyed, allowing for messages to be distributed to partitions based on their keys in a default routing scheme. If no key is present, messages are randomly distributed to partitions.

Message Field

The individual record contained in a topic.