Icon

Standard_​WF_​Andreas

Test only - size reduction

Data Analysis template

Steps:

1)import of: Order data, SKU master data & stock snapshort

2) configure data type, naming convention and dimension of SKU & clean data (double lines, negative Quantities,...)

3) Enter AS bin types

4) Different standard analysis are available

1) Import Order data:

  • import order data files

  • if several files use "concentante node" to apped files (columns if different files should have same naming and same data type)

    • if problems try to import as data type "String" under sheet "Transformation"

    • usefull nodes "Concentenate" & String Manipulation"

    • typical nodes (CSV reader, excel reader, file reader) :

2) Import Master data:

  • import master data file

  • if problems try to import as data type "String" under sheet "Transformation"

    • typical nodes:

3) Import Stock data:

  • import stock data file

  • if problems try to import as data type "String" under sheet "Transformation"

  • ATTENTION if multiple days in stock snapshot

Import order data:

1.1) Configure:

  • Renaming of columns to fit the right naming

  • IF necessary convert Date from String to Date format

  • If necessary convert Qty to Integer from String

2.1) Configure:

  • Renaming of columns to fit the right naming

3.1) Configure:

  • Renaming of columns to fit the right naming

Order data Data cleaning process

  • Convert date format

  • filter: only lines with Integer Qty => 1

  • Double lines: Same Date, Order_ID and SKU_ID are grouped and the qty is summed up (possible consequence: reduced number of order lines per day)

SKU: Data cleaning process

  • missing dimensions / weight is replace with 0

    • alternative approaches are not in

  • conversion into Kg and mm

  • lines with neg or 0 dim (length or width or height are filter out)

  • only one line per SKU (first line considered)

  • Calculation of Volume in l

Stock: Data cleaning process

  • conversion to int for QTY

  • Search for peak day by qty

  • sum up stock over possbile different lines for same SKU

    • consider only positive summed up stock

2.2) Configure

  • define UOM in original master data

Criteria for double lines

  • Date, Order Id & SKU

Posiiblity to add STring columns in group node:

  • all string columns could be filter in analysis

Merge Data Files

Order, Sku Master & Stock

Overview Data Quality

Container Assignment Tool

4) Choose TU Types

Test only

1.3) Data Analysis (order data)

1.4) Bin and Task distribution & Hitrate

5) with or/and without master data

6) analysis with or/and without master data

check formats and look if column exists
Table Validator (Reference)
Rename Columns
Column Renamer
check for double SKU IDstake first value for dim and weight, if double SKU than only take first SKU line
Duplicate Row Filter
Table Structure Creator
Development of hitrate with growing batch size
Excel Reader
if serveral days: caluclates peak day (by QTY on stock) and only considers stock on peak day
Peak day in QTY on stock
Double lines handling:by date order and SKUsum QTY, take first time stamp
GroupBy
filter out negative stockATTENTION: QTY was summed up before
Row Filter
group SKU with dimensions.calculation per SKU: -order lines-SKU turnover qty-active days-stock
Metanode
only lines with positive QTY, filter out qty <1
Row Filter
remane colums
Column Renamer
sum up all qty (evtl different s torage locations) -> description is number of different lines per SKU (e.g. more than one location)
GroupBy
Component
Merge Stock & Master data, do not consider stock without master data
Joiner
ABC XYZ
goldern bear
Excel Reader
CSV Reader
check for double linesSAME Day, Order ID and SKU
Duplicate Row Filter
File Reader
add column: lines with or without master data
Metanode
missing values are set to 0
Missing Value
Pareto curves by Qty, Ol & Volume
Table Cropper
Component
Overview_data_cleaning_(orders)
stock to double
String to Number
ADD Container Aysingment to order data
Joiner
Filter AS SKU only
Metanode
Sorter
Overview data quality (2)
Duplicate Row Filter
modify strings
String Manipulation
Define business logic
Define business rules
CSV Reader
SKU w/o 0 or neg dim
Row Filter
Convert String to Date
String to Date&Time
append multiple files to each other
Concatenate
Excel Reader
Excel Writer
TU definition
Table Creator (deprecated)
golden bear
Excel Reader
calculation of SKU Volume
Math Formula
SKU lines with 0 or neg dimensions
Row Filter
String Manipulation
w/o duplicate SKU
Row Filter
String Manipulation
apply business logic - see user manual as well
CA - Logic
Results
Component
Convert String to Date
String to Date&Time
Conversion of dimensions und weight
take all SKU with master datawith stock & without stockSKU without master data are not considered
Concatenate
String to double
String to Number
Table Structure Creator
remane colums
Column Renamer
Table Validator (Reference)
ABC cuve and Bin distribution
Excel Writer
old
Data Analysis
Join order and master data
Joiner
export failure node
Excel Writer
Table Structure Creator
Possible export of qty <=1 and double lines
Excel Writer
Table Validator (Reference)

Nodes

Extensions

Links