Icon

TestWorkflow

In Database Processing & Storage (ELT mode and not ETL) Storage Reading the input fileInput file (in AWS Storage/locally)Assume local path if convenientCreate the staging table from CSV dataConnection to the DatabaseFilter for US recordsFilter for non-US recordsWrite to target table 1Write to target table 2Capture the file name into a columnGenerate current date & timestampas Last_Updated_dttmAssociate date time stamp with all the recordsKeep required columns onlyKeep required columns onlyCreate the measure ActiveCleanup column names CSV Reader Create File Name DB Writer Microsoft SQLServer Connector DB Row Filter DB Row Filter DB ConnectionTable Writer DB ConnectionTable Writer Variable toTable Column Create Date&TimeRange Cross Joiner DB Column Filter DB Column Filter DB Query DB Column Rename In Database Processing & Storage (ELT mode and not ETL) Storage Reading the input fileInput file (in AWS Storage/locally)Assume local path if convenientCreate the staging table from CSV dataConnection to the DatabaseFilter for US recordsFilter for non-US recordsWrite to target table 1Write to target table 2Capture the file name into a columnGenerate current date & timestampas Last_Updated_dttmAssociate date time stamp with all the recordsKeep required columns onlyKeep required columns onlyCreate the measure ActiveCleanup column names CSV Reader Create File Name DB Writer Microsoft SQLServer Connector DB Row Filter DB Row Filter DB ConnectionTable Writer DB ConnectionTable Writer Variable toTable Column Create Date&TimeRange Cross Joiner DB Column Filter DB Column Filter DB Query DB Column Rename

Nodes

Extensions

Links