Icon

Day3_​S1_​Irregular_​Sampling

1 · Time Alignment

Read Day 2's table and sort each pump's readings by time.

Step 1 · Read and put in order


  1. Read the Day 2 monitor table with CSV Reader
  2. Turn the text timestamp into a real date-time with String to Date&Time
  3. Sort by pump then time with Sorter

2 · Regular Sampling

Collapse to one row per pump-hour, then fill the gaps.

Step 2 · Make the sampling regular


  1. One row per pump-hour, averaging duplicate readings, with GroupBy
  2. Fill the hours that are still empty with Missing Value, linear interpolation

3 · Smoothing Per Pump

Loop per pump so a window never crosses machines.

Step 3 · Smooth inside each pump


  1. Start one pass per pump with Group Loop Start
  2. Take a 24-hour rolling mean with Moving Aggregator
  3. Collect every pump back into one table with Loop End

4 · Quality Gate, Explore

Score quality, then profile columns and coverage.

Step 4 · Quality gate and profile


  1. Score quality with Rule Engine, split with Row Splitter
  2. Profile columns with Statistics
  3. Per-pump coverage with GroupBy, one colour per pump with Color Manager

Explore before you decide

Profile the aligned signal before Step 4 locks any threshold.

Explore · Profile before locking


  1. Profile columns with Statistics
  2. Per-pump coverage with GroupBy, one colour per pump with Color Manager
  3. bearing_temp_c: spread with Histogram, over time with Line Plot
  4. HIGH vs LOW with Box Plot, against flow_m3h with Scatter Plot
Node 1Declare Day 3 constants5 constants
Variable Creator
Node 2Read CSVsensors_2025q1
CSV Reader
EX Node 19Per-pump coveragerows, first/last time
GroupBy
Node 3Parse timestampyyyy-MM-dd HH:mm:ss
String to Date&Time
Node 4Sort rowspump_id then time
Sorter
Node 5Mean per timestampgroup pump + time
GroupBy
Node 6Dedup checkpump+time -> 0 left
Duplicate Row Filter
Node 7Fill sensor gapslinear interp
Missing Value
EX Node 201 colour / pumpsame across plots
Color Manager
Node 10Gap to prior rowhours
Date&Time Difference (deprecated)
EX Node 21temp_c spreadwatched variable
Histogram
Node 8Group Loop Startgroup = pump_id
Group Loop Start
Node 13Table Validatortemp + flow range
Table Validator
EX Node 24temp vs its drivertemp_c vs flow_m3h
Scatter Plot
Node 9Lag Column1-row lag
Lag Column
Node 14Write day03_s1for Session 2
CSV Writer
Node 11Rolling mean24-hour backward
Moving Aggregator
EX Node 22temp_c vs timeper pump, colored
Line Plot
Node 12Loop Endstack all pumps
Loop End
EX Node 23temp_c by regimeHIGH vs LOW
Box Plot
Node 17Quality gatePASS vs FAIL rows
Row Splitter
EX Node 18Profile columnsn,miss,min/max,SD
Statistics
Node 15Read dirty fileaux_dirty_2025q1
CSV Reader
Node 16Quality score5 sensors, +/-4SD
Rule Engine

Nodes

Extensions

Links