Stanford NLP transform Icon Stanford NLP Transform

Description

Stanford CoreNLP provides a set of natural language analysis tools which can take raw English language text input and give the base forms of words, their parts of speech, whether they are names of companies, people, etc., normalize dates, times, and numeric quantities, mark up the structure of sentences in terms of phrases and word dependencies, and indicate which noun phrases refer to the same entities. It provides the foundational building blocks for higher level text understanding applications.

Supported Engines

Hop Engine

Supported

Single Threaded

Supported

Native Spark

Supported

Beam Spark

Maybe Supported

Beam Flink

Maybe Supported

Beam Dataflow

Maybe Supported

Installation

This transform is not part of the default Hop client. Install it from the Marketplace perspective in Hop Gui (Stanford NLP, category Transforms), or with the marketplace command line:

./hop marketplace install hop-transform-stanfordnlp

The plugin ships the supporting libraries, but Stanford CoreNLP itself is licensed under the GPL v3 and can not be distributed by the Apache Software Foundation. Download the following two jars and drop them in the plugins/transforms/stanfordnlp/lib folder:

- stanford-corenlp 4.5.10
- xom 1.3.9

The language models are not distributed either: pick the model for your language and drop it in the same plugins/transforms/stanfordnlp/lib folder.

- Arabic Model
- Chinese Model
- English Model
- French Model
- German Model
- Hungarian Model
- Italian Model
- Spanish Model