Icon

everdrop_​case_​2

Cohort Creation

Data Access

  1. Access Data using Parquet Reader
    .parquet files read through workflow data. This connection can be done various way. Since the data I work with is static, data read connected to a static file. Connection can be dynamic as well. For example, direct database connection with SQL queries.

Data Cleaning

  1. Remove Duplicate Rows

    1. from orders data remove duplicate order ids

    2. from products data remove duplicate rows

  2. Turned String Date to Date&Tıme format

  3. Format Date and Time as YYYY-MM

  4. Product Items Splitted into rows

    1. comma seperated cell turned into a list. Because lists contains duplicate items customer could buy same item more than once in the same order.

    2. then list turned into seperate row.

  5. Splitted Column name changed to product_title (same column name from products data table.

  6. Joined two table using Left Join (Orders data on the left)

    This allow us to include the data from products table to orders table like product category and price. Total number of rows did not change since the duplicate rows are removed.

Test Case

  1. Group By node calculates the sum of items and create total chart amount. With the example below, more than one item purchased, checked the result. The both results match as they should be.

  2. Tested if the first order date is calculated correctly. There are no created date earlier than first order date.

Visualization

Cell Splitter
Ungroup
Joiner
GroupBy
Sorter
Column Filter
Math Formula
Number to String
Column Filter
Date&Time Difference
Date&Time Difference
Math Formula
Number to String
Heatmap
Heatmap
Date&Time to String
Color Manager
Math Formula
Duplicate Row Filter
Column Renamer
Duplicate Row Filter
Number to String
Row Filter
GroupBy
Row Filter
Parquet Reader
Parquet Reader
String to Date&Time
GroupBy
Math Formula
Column Resorter
Color Manager
GroupBy
Component
Row Filter
Sorter
Joiner
Sorter
Number to String
One to Many
Math Formula
Sorter
Date&Time Format Manager
Expression Row Filter
Row Filter
Color Manager
Sorter
GroupBy
Expression Row Filter
Concatenate
Time Zone Modifier
Expression Row Filter
Row Splitter

Nodes

Extensions

Links