Detect language

Description

The Detect language transform examine text to identify the language.

list of supported languages

Supported Engines

Hop Engine

Supported

Single Threaded

Supported

Native Spark

Supported

Beam Spark

Maybe Supported

Beam Flink

Maybe Supported

Beam Dataflow

Maybe Supported

Options

Option	Description
Transform name	Name of the transform. This name must be unique throughout the pipeline.

Option

Description

Transform name

Name of the transform. This name must be unique throughout the pipeline.

Installation

This transform is not part of the default Hop client. Install it from the Marketplace perspective in Hop Gui (Detect language, category Transforms), or with the marketplace command line:

bash

./hop marketplace install hop-transform-detectlanguage

The Lingua language models and fastutil are bundled with the plugin, so no jars have to be downloaded by hand. Because the language models are large, the plugin is around 100MB in size.