Icon

m_​001_​python_​problems_​with_​column_​names

Problem with KNIME and Python and leading underscore in column name

Problem with KNIME and Python and leading underscore in column name

import numpy as npimport pandas as pdimport pyarrow.parquet as pq# import sqlite3v_path_pickle_file = flow_variables['v_path_pickle_file']v_parquet_file = flow_variables['v_path_parquet_file_1']df = pd.read_pickle(v_path_pickle_file)print(df.dtypes)df = df.drop(columns=["_merge"])print(list(df))# export as parquetdf.to_parquet(v_parquet_file, compression='gzip')output_table = df.copy() Problem with KNIME and Python and leading underscore in column namehttps://forum.knime.com/t/python-source-node-error-python-source-execute-failed-fill-value-must-be-in-categories/27826/11 drop columns_merge=> works finev_path_pickle_filev_path_parquet_file_1data/test_file_1.parquetv_path_parquet_file_2data/test_file_2.parquetfails with renamed columnrestore_merge Python Source collect meta data Java EditVariable (simple) Java EditVariable (simple) Parquet Reader Java EditVariable (simple) Parquet Reader Python Source Python Script (1⇒1) Column Rename import numpy as npimport pandas as pdimport pyarrow.parquet as pq# import sqlite3v_path_pickle_file = flow_variables['v_path_pickle_file']v_parquet_file = flow_variables['v_path_parquet_file_1']df = pd.read_pickle(v_path_pickle_file)print(df.dtypes)df = df.drop(columns=["_merge"])print(list(df))# export as parquetdf.to_parquet(v_parquet_file, compression='gzip')output_table = df.copy() Problem with KNIME and Python and leading underscore in column namehttps://forum.knime.com/t/python-source-node-error-python-source-execute-failed-fill-value-must-be-in-categories/27826/11 drop columns_merge=> works finev_path_pickle_filev_path_parquet_file_1data/test_file_1.parquetv_path_parquet_file_2data/test_file_2.parquetfails with renamed columnrestore_mergePython Source collect meta data Java EditVariable (simple) Java EditVariable (simple) Parquet Reader Java EditVariable (simple) Parquet Reader Python Source Python Script (1⇒1) Column Rename

Nodes

Extensions

Links

Download

To use this workflow in KNIME, download it from the below URL and open it in KNIME:

Download Workflow
Created by: paper
Created at: 2020-10-07
On NodePit since: 2020-10-08
Last update: 2024-04-27
Created with KNIME version: v4.2.2
Tags: pythonpandascolumnnamerename

Deploy, schedule, execute, and monitor your KNIME workflows locally, in the cloud or on-premises – with our brand new NodePit Runner.

Try NodePit Runner!