Doris Bulk Loader
Options
General
| Option | Description |
|---|---|
Transform name | Name of the transform; This name has to be unique in a single pipeline |
FE Host | Hostname of the FE Host |
FE HTTP Port | Port used to connect to the FE Host |
Database Name | The database you want to connect to |
Table Name | Table name to bulk load records to |
Login User | User used to connect to the database |
Login Password | Password to connect to the database |
Data Field | The Data has to be combined to a single field, this can be a csv style field or json data |
Format | Indicator to tell the transform it is expecting CSV style or JSON style data |
Line Delimiter | The Delimiter used to indicate line endings |
Column separator | When using CSV style data this will indicate what character to split fields on |
Buffer Size | Size of the buffer in bytes (0 = unlimited) |
Buffer Count | Buffer Size * Buffer Count is the max capacity to buffer data before doing real stream load (0 = unlimited) |