Icon

kn_​forum_​58594_​explore_​sensor_​data_​file

Import and explore possible sensor data (KNIME forum entry 58594, 58393) - create reports with pandas-profiler and sweetviz

Import and explore possible sensor data (KNIME forum entry 58594, 58393) - create reports with pandas-profiler and sweetviz

Import and explore possible sensor data (KNIME forum entry 58594, 58393) - create reports with pandas-profiler and sweetvizhttps://forum.knime.com/t/best-3-training-methods-to-test/58393/4?u=mlauber71in the sub-folder /data/ there is a Jupyter notebook to create reports about the data "sensor_data_report.ipynb" Python Conda environment propagation. Please read this article for more details:KNIME and Python — Setting up and managing Conda environmentshttps://medium.com/p/2ac217792539 import knime.scripting.io as knioimport pandas as pd import numpy as npimport pandas_profilingimport sweetviz as svdf = knio.input_tables[0].to_pandas()v_pandas_profiler_path = knio.flow_variables['var_pandas_profiler_path']v_sweetviz_path = knio.flow_variables['var_sweetviz_path']# Generate a reportreport = pandas_profiling.ProfileReport(df)report.to_file(v_pandas_profiler_path)# https://pypi.org/project/sweetviz/# use Sweetvizreport_sv = sv.analyze([df, "Sensor_Data_report"],target_feat="times_in_cycles")report_sv.show_html( filepath=v_sweetviz_path, open_browser=False, layout='widescreen', scale=None) data6.txtheader.xlsxsensor_data.tablesensor_data.parquetNode 6create tow reports for thedataThe Swetviz Report with a Target variable"times_in_cycles"Propagate Python environmentfor KNIME on MacOSX (Apple Scilicon)with Miniforge / Minicondaconfigure how to handle the environmentdefault = just check the namesPropagate Python environmentfor KNIME on MacOSX withMiniforge / Minicondaconfigure how to handle the environmentdefault = just check the namesPropagate Python environmentfor KNIME on Windows withMiniforge / Minicondaconfigure how to handle the environmentdefault = just check the namesvar_sweetviz_pathvar_pandas_profiler_pathSWEETVIZ_REPORT.zippandas_profiler_report.zip CSV Reader Excel Reader Insert ColumnHeader Table Writer Parquet Writer Data Explorer Python Script collect meta data conda_environment_kaggle_apple_silicon conda_environment_kaggle_macosx conda_environment_kaggle_windows Merge Variables Java EditVariable (simple) Java EditVariable (simple) CompressFiles/Folder String to Path(Variable) CompressFiles/Folder Import and explore possible sensor data (KNIME forum entry 58594, 58393) - create reports with pandas-profiler and sweetvizhttps://forum.knime.com/t/best-3-training-methods-to-test/58393/4?u=mlauber71in the sub-folder /data/ there is a Jupyter notebook to create reports about the data "sensor_data_report.ipynb" Python Conda environment propagation. Please read this article for more details:KNIME and Python — Setting up and managing Conda environmentshttps://medium.com/p/2ac217792539 import knime.scripting.io as knioimport pandas as pd import numpy as npimport pandas_profilingimport sweetviz as svdf = knio.input_tables[0].to_pandas()v_pandas_profiler_path = knio.flow_variables['var_pandas_profiler_path']v_sweetviz_path = knio.flow_variables['var_sweetviz_path']# Generate a reportreport = pandas_profiling.ProfileReport(df)report.to_file(v_pandas_profiler_path)# https://pypi.org/project/sweetviz/# use Sweetvizreport_sv = sv.analyze([df, "Sensor_Data_report"],target_feat="times_in_cycles")report_sv.show_html( filepath=v_sweetviz_path, open_browser=False, layout='widescreen', scale=None) data6.txtheader.xlsxsensor_data.tablesensor_data.parquetNode 6create tow reports for thedataThe Swetviz Report with a Target variable"times_in_cycles"Propagate Python environmentfor KNIME on MacOSX (Apple Scilicon)with Miniforge / Minicondaconfigure how to handle the environmentdefault = just check the namesPropagate Python environmentfor KNIME on MacOSX withMiniforge / Minicondaconfigure how to handle the environmentdefault = just check the namesPropagate Python environmentfor KNIME on Windows withMiniforge / Minicondaconfigure how to handle the environmentdefault = just check the namesvar_sweetviz_pathvar_pandas_profiler_pathSWEETVIZ_REPORT.zippandas_profiler_report.zipCSV Reader Excel Reader Insert ColumnHeader Table Writer Parquet Writer Data Explorer Python Script collect meta data conda_environment_kaggle_apple_silicon conda_environment_kaggle_macosx conda_environment_kaggle_windows Merge Variables Java EditVariable (simple) Java EditVariable (simple) CompressFiles/Folder String to Path(Variable) CompressFiles/Folder

Nodes

Extensions

Links

Download

To use this workflow in KNIME, download it from the below URL and open it in KNIME:

Download Workflow
Created by: m_lauber
Created at: 2023-01-06
On NodePit since: 2023-01-07
Last update: 2024-04-27
Created with KNIME version: v4.7.0
Tags: reportsensordataexplorepythonprofilersweetviz

Deploy, schedule, execute, and monitor your KNIME workflows locally, in the cloud or on-premises – with our brand new NodePit Runner.

Try NodePit Runner!