Icon

08_​Filtering_​Duplicates

Duplicate Row Filter
This workflow shows how to remove or flag duplicates in the data set and the different options todefine which row to keep using the Duplicate Row Filter node.For more detailed information see the workflow metadata. Find it here: View -> Description Simply removingduplicates from dataset Flagging Duplicates Read the adult.csvdataAdd column flag if row isunique, duplicate orchosenAdd column to identify the ROWIDof chosen row to each duplicate rowkeep the first appearanceof the duplicateskeep the last appearanceof the duplicateskeep the rowwith minimum agekeep the rowwith maximum ageAdd both flag types File Reader DuplicateRow Filter DuplicateRow Filter DuplicateRow Filter DuplicateRow Filter DuplicateRow Filter DuplicateRow Filter DuplicateRow Filter This workflow shows how to remove or flag duplicates in the data set and the different options todefine which row to keep using the Duplicate Row Filter node.For more detailed information see the workflow metadata. Find it here: View -> Description Simply removingduplicates from dataset Flagging Duplicates Read the adult.csvdataAdd column flag if row isunique, duplicate orchosenAdd column to identify the ROWIDof chosen row to each duplicate rowkeep the first appearanceof the duplicateskeep the last appearanceof the duplicateskeep the rowwith minimum agekeep the rowwith maximum ageAdd both flag types File Reader DuplicateRow Filter DuplicateRow Filter DuplicateRow Filter DuplicateRow Filter DuplicateRow Filter DuplicateRow Filter DuplicateRow Filter

Nodes

Extensions

Links

Download

To use this workflow in KNIME, download it from the below URL and open it in KNIME:

Download Workflow
Created by: Ana Vedoveli
Created at: 2019-09-27
On NodePit since: 2019-10-18
Last update: 2024-04-18
Created with KNIME version: v4.1.0
Tags: duplicatesdata manipulationduplicate row filterETLrow filtering

Deploy, schedule, execute, and monitor your KNIME workflows locally, in the cloud or on-premises – with our brand new NodePit Runner.

Try NodePit Runner!