5 workflows in this folder and its subfolders
Reads 300+ CompanyInformation JSON files, flattens to normalized schema, separates officer roster, and loads to stg.stg_company_info and stg.stg_company_officers.
CSV Reader & Loader
End-to-End ETL Orchestrator - Orchestrates the full KNIME to PostgreSQL pipeline: truncate stg, run all reader workflows, promote to dw, refresh analytics views, log results.
Reads _financial_statements.json files from dataset/*/Financial Statement Data/. Extracts income_statement, balance_sheet, cashflow via JSON Path -> JSON to Table -> Ungroup. Concatenates the 3 branches, derives sector/source_file from path, parses period_end, sets ticker and load_batch_id from flow…
Industry Average Reader - reads industry_avg_df.csv files from all 15 sector folders, adds sector/date_key/daily_return columns, and appends to stg.stg_industry_avg in PostgreSQL.