Icon

Write and Find Duplicate Files

Write and Find Duplicate Files
create sample data Use Hash Files component to identify content-wise duplicatefiles. calculate unique fingerprintsof the content of each file:* duplicate files will have thesame hash value* different hash valuesmean different file contentsample dataiterateover filesFile Name toflow variablerelative toworkflow data areaidentify duplicatestop: contentbottom: file pathHash Files Table Creator CSV Writer Chunk Loop Start Table Rowto Variable Loop End String to Path DuplicateRow Filter Path to String Column Splitter create sample data Use Hash Files component to identify content-wise duplicatefiles. calculate unique fingerprintsof the content of each file:* duplicate files will have thesame hash value* different hash valuesmean different file contentsample dataiterateover filesFile Name toflow variablerelative toworkflow data areaidentify duplicatestop: contentbottom: file pathHash Files Table Creator CSV Writer Chunk Loop Start Table Rowto Variable Loop End String to Path DuplicateRow Filter Path to String Column Splitter

Nodes

Extensions

Links

Download

To use this workflow in KNIME, download it from the below URL and open it in KNIME:

Download Workflow
Created by: Arne
Created at: 2022-05-21
On NodePit since: 2022-05-29
Last update: 2024-11-21
Created with KNIME version: v4.5.1
Tags: hashduplicate

Deploy, schedule, execute, and monitor your KNIME workflows locally, in the cloud or on-premises – with our brand new NodePit Runner.

Try NodePit Runner!