Icon

kn_​example_​python_​parquet_​jupyter

Parquet file format, KNIME and Jupyter notebook

Parquet file format, KNIME and Jupyter notebook
- work in progress -

/data/kn_example_python_parquet_jupyter.ipynb
a jupyter workbook with several way to import and export Parquet data. Also to be read by KNIME's parquet reader and Arrow package

Parquet file format, KNIME and Jupyter notebook- work in progress - /data/kn_example_python_parquet_jupyter.ipynba jupyter workbook with several way to import and export Parquet data. Also to be read by KNIME's parquet reader and Arrow package conda update condaconda activate kaggleconda update -n kaggle --alljupyter notebook create data fromscratch in Pythondf_pa_010_version_2.6.parquetpq.write_table(df_pa, "df_pa_010_version_2.6.parquet", version='2.6')from_knime_001.parquettest_data_all_typesNode 261df_001.parquetdf.to_parquet("df_001.parquet", compression='gzip')df_005_fastparquet.parquetdf.to_parquet("df_005_fastparquet.parquet", compression="gzip", engine="fastparquet")df_pa_001.parquetpq.write_table(df_pa, "df_pa_001.parquet") - London - Eastern USNode 267Propagate Python environmentfor KNIME on MacOSX withMiniforge / Minicondaconfigure how to handle the environmentdefault = just check the namesPropagate Python environmentfor KNIME on Windows withMiniforge / Minicondaconfigure how to handle the environmentdefault = just check the names Python Script(Labs) Parquet Reader Parquet Writer Test Data Generator prepare_data Column Rename Parquet Reader Parquet Reader Parquet Reader Modify Time Zone Modify Time Zone Column Resorter conda_environment_kaggle_macosx conda_environment_kaggle_windows Parquet file format, KNIME and Jupyter notebook- work in progress - /data/kn_example_python_parquet_jupyter.ipynba jupyter workbook with several way to import and export Parquet data. Also to be read by KNIME's parquet reader and Arrow package conda update condaconda activate kaggleconda update -n kaggle --alljupyter notebook create data fromscratch in Pythondf_pa_010_version_2.6.parquetpq.write_table(df_pa, "df_pa_010_version_2.6.parquet", version='2.6')from_knime_001.parquettest_data_all_typesNode 261df_001.parquetdf.to_parquet("df_001.parquet", compression='gzip')df_005_fastparquet.parquetdf.to_parquet("df_005_fastparquet.parquet", compression="gzip", engine="fastparquet")df_pa_001.parquetpq.write_table(df_pa, "df_pa_001.parquet") - London - Eastern USNode 267Propagate Python environmentfor KNIME on MacOSX withMiniforge / Minicondaconfigure how to handle the environmentdefault = just check the namesPropagate Python environmentfor KNIME on Windows withMiniforge / Minicondaconfigure how to handle the environmentdefault = just check the namesPython Script(Labs) Parquet Reader Parquet Writer Test Data Generator prepare_data Column Rename Parquet Reader Parquet Reader Parquet Reader Modify Time Zone Modify Time Zone Column Resorter conda_environment_kaggle_macosx conda_environment_kaggle_windows

Nodes

Extensions

Links

Download

To use this workflow in KNIME, download it from the below URL and open it in KNIME:

Download Workflow
Created by: m_lauber
Created at: 2022-11-02
On NodePit since: 2022-11-03
Last update: 2024-04-27
Created with KNIME version: v4.6.3
Tags: knimepythonjupyterparquetformatfatsparquetarrow

Deploy, schedule, execute, and monitor your KNIME workflows locally, in the cloud or on-premises – with our brand new NodePit Runner.

Try NodePit Runner!