Icon

05_​Neural_​Machine_​Translation

Neural Machine Translation English to German

Uses a character level encoder-decoder network of LSTMs.
The encoder network reads the input sentence character by character and summarizes the sentence in its state.
This state is then used as initial state of the decoder network to produce the translated sentence one character at a time.
During prediction, the decoder also recieves its previous output as input to the next time.
For training we use a technique called "teacher forcing" i.e. we feed the actual previous character instead of the previous prediction which greatly benefits the training.

This example is an adaptation of the following Keras blog post to KNIME:
https://blog.keras.io/a-ten-minute-introduction-to-sequence-to-sequence-learning-in-keras.html

In order to run the example, please make sure you have the following KNIME extensions installed:

* KNIME Deep Learning - Keras Integration (Labs)

You also need a local Python installation that includes Keras. Please refer to https://www.knime.com/deeplearning#keras for installation recommendations and further information.

Neural Language Translation English to GermanUses a character level encoder-decoder network of LSTMs. Preprocessing Training Deployment Evaluation Add tab to target (German)to mark start of sequenceextract char setsindex encodeand padtrain for100 epochswith RMSPropget dictionarysizesindex decodeencoder-decoderUse onlyfirst 10k rows File Reader String Manipulation Python Script (1⇒1) Python Script (2⇒1) DL PythonNetwork Learner Java Snippet DL Python NetworkExecutor Python Script (2⇒1) DL PythonNetwork Creator Partitioning Row Sampling Table View Neural Language Translation English to GermanUses a character level encoder-decoder network of LSTMs. Preprocessing Training Deployment Evaluation Add tab to target (German)to mark start of sequenceextract char setsindex encodeand padtrain for100 epochswith RMSPropget dictionarysizesindex decodeencoder-decoderUse onlyfirst 10k rowsFile Reader String Manipulation Python Script (1⇒1) Python Script (2⇒1) DL PythonNetwork Learner Java Snippet DL Python NetworkExecutor Python Script (2⇒1) DL PythonNetwork Creator Partitioning Row Sampling Table View

Nodes

Extensions

Links