Next steps

You’ve built a pipeline, orchestrated it from a workflow, handled a failure path, and put both in a project. That is the core loop of working with Hop. Everything else is more of it.

Where you go next depends on what you’re trying to do.

Build more pipelines

Pipelines - the full picture, including the complete list of transforms
Run, Preview and Debug a Pipeline - preview a subset, pause on a condition, step through rows
Error Handling - send failing rows down a separate hop instead of stopping
Fields, parameters and variables - three things that look alike in the UI and behave differently
Pipeline Unit Tests - golden data sets and assertions for your pipelines

Orchestrate more

Workflows - the full picture, including the complete list of actions
Scheduling workflows and pipelines - cron, systemd, Jenkins, Kubernetes CronJob and Apache Airflow

Connect to your data

Databases - relational connections and the drivers Hop ships
VFS - read and write on AWS, Azure and GCP as if they were local files
Change Data Capture - log sniffing, filtered selection and snapshot comparison
Metadata types - everything you can define once and reuse

Run it somewhere else

Projects - the full reference for projects and environments
Deploying Hop Server - three ways to get a project onto a running server
Hop in Docker - the apache/hop image
Pipeline run configurations - run the same pipeline on Apache Spark, Apache Flink or Google Dataflow without changing it
Logging - log levels and where to send the output

Work like a team

Working with git - commit, diff and browse history from inside Hop Gui
Best Practices - what experienced Hop developers wish they had known
Linting - static checks on pipelines, workflows and metadata, locally or in CI

Coming from Kettle or PDI?

Hop vs Kettle - what changed and why
If you know Kettle - the vocabulary mapping
Upgrade Kettle to Hop - convert an existing repository

Get help

Hop is an Apache project, and the community is where questions get answered. See the community pages for the mailing lists, chat and issue tracker.