Icon

kn_​forum_​63705_​pandas_​duplicates_​error

forum question (63705) - error with collection python

forum question (63705) - error with collection python

forum question (63705) - error with collection python 2023-03-21 18:04:43,382 : DEBUG : main : : NodeContainerEditPart : : : Python Script 5:1 (CONFIGURED)2023-03-21 18:04:44,482 : DEBUG : main : : ExecuteAction : : : Creating execution job for 1 node(s)...2023-03-21 18:04:44,487 : DEBUG : main : : NodeContainer : : : Setting dirty flag on Python Script 5:12023-03-21 18:04:44,487 : DEBUG : main : : NodeContainer : : : Setting dirty flag on kn_forum_63705_pandas_duplicates_error 52023-03-21 18:04:44,490 : DEBUG : main : : NodeContainer : : : Python Script 5:1 has new state: CONFIGURED_MARKEDFOREXEC2023-03-21 18:04:44,493 : DEBUG : main : : NodeContainer : : : Python Script 5:1 has new state: CONFIGURED_QUEUED2023-03-21 18:04:44,497 : DEBUG : main : : NodeContainer : : : kn_forum_63705_pandas_duplicates_error 5 has new state: EXECUTING2023-03-21 18:04:44,505 : DEBUG : KNIME-Workflow-Notifier : : WorkflowEditor : : : Workflow event triggered: WorkflowEvent [type=WORKFLOW_DIRTY;node=5;old=null;new=null;timestamp=21.03.2023,18:04:44]2023-03-21 18:04:44,507 : DEBUG : KNIME-Worker-304-Python Script 5:1 : : WorkflowManager : Python Script : 5:1 : Python Script 5:1 doBeforePreExecution2023-03-21 18:04:44,509 : DEBUG : KNIME-Worker-304-Python Script 5:1 : : NodeContainer : Python Script : 5:1 : Python Script 5:1 has new state: PREEXECUTE2023-03-21 18:04:44,513 : DEBUG : KNIME-Worker-304-Python Script 5:1 : : WorkflowDataRepository : Python Script : 5:1 : Adding handler 8e29199b-f434-4d32-a892-d96ad8ae7b07 (Python Script 5:1: <nodirectory>) - 17 in total2023-03-21 18:04:44,513 : DEBUG : KNIME-Worker-304-Python Script 5:1 : : WorkflowManager : Python Script : 5:1 : Python Script 5:1 doBeforeExecution2023-03-21 18:04:44,513 : DEBUG : KNIME-Worker-304-Python Script 5:1 : : NodeContainer : Python Script : 5:1 : Python Script 5:1 has new state: EXECUTING2023-03-21 18:04:44,516 : DEBUG : KNIME-Worker-304-Python Script 5:1 : : LocalNodeExecutionJob : Python Script : 5:1 : Python Script 5:1 Start execute2023-03-21 18:04:45,181 : INFO : Thread-2337 : : PythonKernel : Python Script : 5:1 : 1.5.22023-03-21 18:04:45,182 : INFO : Thread-2337 : : PythonKernel : Python Script : 5:1 : 3.9.15 | packaged by conda-forge | (main, Nov 22 2022, 08:55:37) 2023-03-21 18:04:45,182 : INFO : Thread-2337 : : PythonKernel : Python Script : 5:1 : [Clang 14.0.6 ]2023-03-21 18:04:45,242 : DEBUG : KNIME-Worker-304-Python Script 5:1 : : Node : Python Script : 5:1 : reset2023-03-21 18:04:45,244 : ERROR : KNIME-Worker-304-Python Script 5:1 : : Node : Python Script : 5:1 : Execute failed: AttributeError: 'KnimeExtensionArray' object has no attribute 'values'org.knime.python2.kernel.PythonIOException: AttributeError: 'KnimeExtensionArray' object has no attribute 'values' at org.knime.python3.scripting.nodes.AbstractPythonScriptingNodeModel.execute(AbstractPythonScriptingNodeModel.java:294) at org.knime.core.node.NodeModel.executeModel(NodeModel.java:549) at org.knime.core.node.Node.invokeFullyNodeModelExecute(Node.java:1267) at org.knime.core.node.Node.execute(Node.java:1041) at org.knime.core.node.workflow.NativeNodeContainer.performExecuteNode(NativeNodeContainer.java:595) at org.knime.core.node.exec.LocalNodeExecutionJob.mainExecute(LocalNodeExecutionJob.java:98) at org.knime.core.node.workflow.NodeExecutionJob.internalRun(NodeExecutionJob.java:201) at org.knime.core.node.workflow.NodeExecutionJob.run(NodeExecutionJob.java:117) at org.knime.core.util.ThreadUtils$RunnableWithContextImpl.runWithContext(ThreadUtils.java:367) at org.knime.core.util.ThreadUtils$RunnableWithContext.run(ThreadUtils.java:221) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.run(Unknown Source) at org.knime.core.util.ThreadPool$MyFuture.run(ThreadPool.java:123) at org.knime.core.util.ThreadPool$Worker.run(ThreadPool.java:246)Caused by: org.knime.python2.kernel.PythonIOException: Executing the Python script failed: Traceback (most recent call last): File "<string>", line 17, in <module> File "/Applications/KNIME 4.6.0.app/Contents/Eclipse/plugins/org.knime.python3_4.7.1.v202301311311/src/main/python/knime/api/table.py", line 343, in from_pandas return _backend.create_table_from_pandas(data, sentinel, row_ids=row_ids) File "/Applications/KNIME 4.6.0.app/Contents/Eclipse/plugins/org.knime.python3.arrow_4.7.1.v202301311311/src/main/python/knime/_arrow/_table.py", line 140, in create_table_from_pandas return _create_table_from_pandas(data, sentinel, row_ids) File "/Applications/KNIME 4.6.0.app/Contents/Eclipse/plugins/org.knime.python3.arrow_4.7.1.v202301311311/src/main/python/knime/_arrow/_table.py", line 125, in _create_table_from_pandas data = kap.pandas_df_to_arrow(data, row_ids=pandas_row_ids) File "/Applications/KNIME 4.6.0.app/Contents/Eclipse/plugins/org.knime.python3.arrow_4.7.1.v202301311311/src/main/python/knime/_arrow/_pandas.py", line 78, in pandas_df_to_arrow data_frame = _make_arrow_compatible(data_frame) File "/Applications/KNIME 4.6.0.app/Contents/Eclipse/plugins/org.knime.python3.arrow_4.7.1.v202301311311/src/main/python/knime/_arrow/_pandas.py", line 88, in _make_arrow_compatible schema = extract_knime_schema_from_df(data_frame) File "/Applications/KNIME 4.6.0.app/Contents/Eclipse/plugins/org.knime.python3.arrow_4.7.1.v202301311311/src/main/python/knime/_arrow/_pandas.py", line 150, in extract_knime_schema_from_df col_type = _resolve_object_type(df[col_name]) File "/Applications/KNIME 4.6.0.app/Contents/Eclipse/plugins/org.knime.python3.arrow_4.7.1.v202301311311/src/main/python/knime/_arrow/_pandas.py", line 164, in _resolve_object_type dtype = type(cleaned.iloc[0]) File "/Applications/KNIME 4.6.0.app/Contents/Eclipse/plugins/org.knime.pythonscripting.channel.v1.bin.macosx.x86_64_4.7.1.v202301201518/env/lib/python3.9/site-packages/pandas/core/indexing.py", line1073, in __getitem__ return self._getitem_axis(maybe_callable, axis=axis) File "/Applications/KNIME 4.6.0.app/Contents/Eclipse/plugins/org.knime.pythonscripting.channel.v1.bin.macosx.x86_64_4.7.1.v202301201518/env/lib/python3.9/site-packages/pandas/core/indexing.py", line1627, in _getitem_axis return self.obj._ixs(key, axis=axis) File "/Applications/KNIME 4.6.0.app/Contents/Eclipse/plugins/org.knime.pythonscripting.channel.v1.bin.macosx.x86_64_4.7.1.v202301201518/env/lib/python3.9/site-packages/pandas/core/series.py", line 959,in _ixs return self._values[i] File "/Applications/KNIME 4.6.0.app/Contents/Eclipse/plugins/org.knime.python3.arrow_4.7.1.v202301311311/src/main/python/knime/_arrow/_pandas.py", line 624, in __getitem__ storage = self._data.valuesAttributeError: 'KnimeExtensionArray' object has no attribute 'values' at org.knime.python3.scripting.Python3KernelBackend.beautifyPythonTraceback(Python3KernelBackend.java:687) at org.knime.python3.scripting.Python3KernelBackend.beautifyPythonTraceback(Python3KernelBackend.java:664) at org.knime.python3.scripting.Python3KernelBackend.executeAndCheckOutputs(Python3KernelBackend.java:595) at org.knime.python3.scripting.Python3KernelBackend.lambda$15(Python3KernelBackend.java:601) at org.knime.core.util.ThreadUtils$CallableWithContextImpl.callWithContext(ThreadUtils.java:383) at org.knime.core.util.ThreadUtils$CallableWithContext.call(ThreadUtils.java:269) at java.base/java.util.concurrent.FutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source)Caused by: Traceback (most recent call last): File "<string>", line 17, in <module> File "/Applications/KNIME 4.6.0.app/Contents/Eclipse/plugins/org.knime.python3_4.7.1.v202301311311/src/main/python/knime/api/table.py", line 343, in from_pandas return _backend.create_table_from_pandas(data, sentinel, row_ids=row_ids) File "/Applications/KNIME 4.6.0.app/Contents/Eclipse/plugins/org.knime.python3.arrow_4.7.1.v202301311311/src/main/python/knime/_arrow/_table.py", line 140, in create_table_from_pandas return _create_table_from_pandas(data, sentinel, row_ids) File "/Applications/KNIME 4.6.0.app/Contents/Eclipse/plugins/org.knime.python3.arrow_4.7.1.v202301311311/src/main/python/knime/_arrow/_table.py", line 125, in _create_table_from_pandas data = kap.pandas_df_to_arrow(data, row_ids=pandas_row_ids) File "/Applications/KNIME 4.6.0.app/Contents/Eclipse/plugins/org.knime.python3.arrow_4.7.1.v202301311311/src/main/python/knime/_arrow/_pandas.py", line 78, in pandas_df_to_arrow data_frame = _make_arrow_compatible(data_frame) File "/Applications/KNIME 4.6.0.app/Contents/Eclipse/plugins/org.knime.python3.arrow_4.7.1.v202301311311/src/main/python/knime/_arrow/_pandas.py", line 88, in _make_arrow_compatible schema = extract_knime_schema_from_df(data_frame) File "/Applications/KNIME 4.6.0.app/Contents/Eclipse/plugins/org.knime.python3.arrow_4.7.1.v202301311311/src/main/python/knime/_arrow/_pandas.py", line 150, in extract_knime_schema_from_df col_type = _resolve_object_type(df[col_name]) File "/Applications/KNIME 4.6.0.app/Contents/Eclipse/plugins/org.knime.python3.arrow_4.7.1.v202301311311/src/main/python/knime/_arrow/_pandas.py", line 164, in _resolve_object_type dtype = type(cleaned.iloc[0]) File "/Applications/KNIME 4.6.0.app/Contents/Eclipse/plugins/org.knime.pythonscripting.channel.v1.bin.macosx.x86_64_4.7.1.v202301201518/env/lib/python3.9/site-packages/pandas/core/indexing.py", line1073, in __getitem__ return self._getitem_axis(maybe_callable, axis=axis) File "/Applications/KNIME 4.6.0.app/Contents/Eclipse/plugins/org.knime.pythonscripting.channel.v1.bin.macosx.x86_64_4.7.1.v202301201518/env/lib/python3.9/site-packages/pandas/core/indexing.py", line1627, in _getitem_axis return self.obj._ixs(key, axis=axis) File "/Applications/KNIME 4.6.0.app/Contents/Eclipse/plugins/org.knime.pythonscripting.channel.v1.bin.macosx.x86_64_4.7.1.v202301201518/env/lib/python3.9/site-packages/pandas/core/series.py", line 959,in _ixs return self._values[i] File "/Applications/KNIME 4.6.0.app/Contents/Eclipse/plugins/org.knime.python3.arrow_4.7.1.v202301311311/src/main/python/knime/_arrow/_pandas.py", line 624, in __getitem__ storage = self._data.valuesAttributeError: 'KnimeExtensionArray' object has no attribute 'values'2023-03-21 18:04:45,247 : DEBUG : KNIME-Worker-304-Python Script 5:1 : : WorkflowManager : Python Script : 5:1 : Python Script 5:1 doBeforePostExecution2023-03-21 18:04:45,247 : DEBUG : KNIME-Worker-304-Python Script 5:1 : : NodeContainer : Python Script : 5:1 : Python Script 5:1 has new state: POSTEXECUTE2023-03-21 18:04:45,249 : DEBUG : KNIME-Worker-304-Python Script 5:1 : : WorkflowManager : Python Script : 5:1 : Python Script 5:1 doAfterExecute - failure2023-03-21 18:04:45,251 : DEBUG : KNIME-Worker-304-Python Script 5:1 : : Node : Python Script : 5:1 : reset2023-03-21 18:04:45,254 : DEBUG : KNIME-Worker-304-Python Script 5:1 : : Node : Python Script : 5:1 : clean output ports.2023-03-21 18:04:45,255 : DEBUG : KNIME-Worker-304-Python Script 5:1 : : WorkflowDataRepository : Python Script : 5:1 : Removing handler 8e29199b-f434-4d32-a892-d96ad8ae7b07 (Python Script 5:1:<no directory>) - 16 remaining2023-03-21 18:04:45,255 : DEBUG : KNIME-Worker-304-Python Script 5:1 : : NodeContainer : Python Script : 5:1 : Python Script 5:1 has new state: IDLE2023-03-21 18:04:45,258 : DEBUG : KNIME-Worker-304-Python Script 5:1 : : Node : Python Script : 5:1 : Configure succeeded. (Python Script)2023-03-21 18:04:45,258 : DEBUG : KNIME-Worker-304-Python Script 5:1 : : NodeContainer : Python Script : 5:1 : Python Script 5:1 has new state: CONFIGURED2023-03-21 18:04:45,259 : DEBUG : KNIME-Worker-304-Python Script 5:1 : : NodeContainer : Python Script : 5:1 : kn_forum_63705_pandas_duplicates_error 5 has new state: CONFIGURED2023-03-21 18:04:45,754 : DEBUG : python-kernel-creator : : DefaultPythonGateway : : : Connected to Python process with PID: 18444 after ms: 11792023-03-21 18:04:48,547 : DEBUG : main : : WorkflowEditPartFactory : : : Deactivate org.knime.workbench.editor.context2023-03-21 18:04:48,547 : DEBUG : main : : WorkflowEditPartFactory : : : Deactivate org.knime.workbench.editor.context2023-03-21 18:04:48,547 : DEBUG : main : : WorkflowEditPartFactory : : : Deactivate org.knime.workbench.editor.context2023-03-21 18:04:48,547 : DEBUG : main : : WorkflowEditPartFactory : : : Deactivate org.knime.workbench.editor.context2023-03-21 18:04:48,547 : DEBUG : main : : WorkflowEditPartFactory : : : Deactivate org.knime.workbench.editor.context2023-03-21 18:04:48,547 : DEBUG : main : : WorkflowEditPartFactory : : : Deactivate org.knime.workbench.editor.context2023-03-21 18:04:48,547 : DEBUG : main : : WorkflowEditPartFactory : : : Deactivate org.knime.workbench.editor.context2023-03-21 18:04:48,547 : DEBUG : main : : WorkflowEditPartFactory : : : Deactivate org.knime.workbench.editor.context2023-03-21 18:04:48,547 : DEBUG : main : : WorkflowEditPartFactory : : : Deactivate org.knime.workbench.editor.context2023-03-21 18:04:48,547 : DEBUG : main : : WorkflowEditPartFactory : : : Deactivate org.knime.workbench.editor.context2023-03-21 18:04:48,547 : DEBUG : main : : WorkflowEditPartFactory : : : Deactivate org.knime.workbench.editor.context2023-03-21 18:04:48,547 : DEBUG : main : : WorkflowEditPartFactory : : : Deactivate org.knime.workbench.editor.context2023-03-21 18:04:48,547 : DEBUG : main : : WorkflowEditPartFactory : : : Deactivate org.knime.workbench.editor.context2023-03-21 18:04:48,547 : DEBUG : main : : WorkflowEditPartFactory : : : Deactivate org.knime.workbench.editor.context2023-03-21 18:04:48,547 : DEBUG : main : : WorkflowEditPartFactory : : : Deactivate org.knime.workbench.editor.context2023-03-21 18:04:48,547 : DEBUG : main : : WorkflowEditPartFactory : : : Deactivate org.knime.workbench.editor.context2023-03-21 18:04:48,547 : DEBUG : main : : WorkflowEditPartFactory : : : Deactivate org.knime.workbench.editor.context2023-03-21 18:04:48,547 : DEBUG : main : : WorkflowEditPartFactory : : : Deactivate org.knime.workbench.editor.context2023-03-21 18:04:48,547 : DEBUG : main : : WorkflowEditPartFactory : : : Deactivate org.knime.workbench.editor.context2023-03-21 18:04:48,547 : DEBUG : main : : WorkflowEditPartFactory : : : Deactivate org.knime.workbench.editor.context2023-03-21 18:04:48,547 : DEBUG : main : : WorkflowEditPartFactory : : : Deactivate org.knime.workbench.editor.context2023-03-21 18:04:48,547 : DEBUG : main : : WorkflowEditPartFactory : : : Deactivate org.knime.workbench.editor.context2023-03-21 18:04:48,548 : DEBUG : main : : WorkflowEditPartFactory : : : Deactivate org.knime.workbench.editor.context with .drop_duplicates()Node 2Node 3v_path_parquet_filelocate and create/data/ folderwith absolute pathsdf_export_from_knime.parquetv_path_parquet_filewithout .drop_duplicates() Python Script Table Creator GroupBy Java EditVariable (simple) Collect LocalMetadata Parquet Reader String to Path(Variable) Python Script forum question (63705) - error with collection python 2023-03-21 18:04:43,382 : DEBUG : main : : NodeContainerEditPart : : : Python Script 5:1 (CONFIGURED)2023-03-21 18:04:44,482 : DEBUG : main : : ExecuteAction : : : Creating execution job for 1 node(s)...2023-03-21 18:04:44,487 : DEBUG : main : : NodeContainer : : : Setting dirty flag on Python Script 5:12023-03-21 18:04:44,487 : DEBUG : main : : NodeContainer : : : Setting dirty flag on kn_forum_63705_pandas_duplicates_error 52023-03-21 18:04:44,490 : DEBUG : main : : NodeContainer : : : Python Script 5:1 has new state: CONFIGURED_MARKEDFOREXEC2023-03-21 18:04:44,493 : DEBUG : main : : NodeContainer : : : Python Script 5:1 has new state: CONFIGURED_QUEUED2023-03-21 18:04:44,497 : DEBUG : main : : NodeContainer : : : kn_forum_63705_pandas_duplicates_error 5 has new state: EXECUTING2023-03-21 18:04:44,505 : DEBUG : KNIME-Workflow-Notifier : : WorkflowEditor : : : Workflow event triggered: WorkflowEvent [type=WORKFLOW_DIRTY;node=5;old=null;new=null;timestamp=21.03.2023,18:04:44]2023-03-21 18:04:44,507 : DEBUG : KNIME-Worker-304-Python Script 5:1 : : WorkflowManager : Python Script : 5:1 : Python Script 5:1 doBeforePreExecution2023-03-21 18:04:44,509 : DEBUG : KNIME-Worker-304-Python Script 5:1 : : NodeContainer : Python Script : 5:1 : Python Script 5:1 has new state: PREEXECUTE2023-03-21 18:04:44,513 : DEBUG : KNIME-Worker-304-Python Script 5:1 : : WorkflowDataRepository : Python Script : 5:1 : Adding handler 8e29199b-f434-4d32-a892-d96ad8ae7b07 (Python Script 5:1: <nodirectory>) - 17 in total2023-03-21 18:04:44,513 : DEBUG : KNIME-Worker-304-Python Script 5:1 : : WorkflowManager : Python Script : 5:1 : Python Script 5:1 doBeforeExecution2023-03-21 18:04:44,513 : DEBUG : KNIME-Worker-304-Python Script 5:1 : : NodeContainer : Python Script : 5:1 : Python Script 5:1 has new state: EXECUTING2023-03-21 18:04:44,516 : DEBUG : KNIME-Worker-304-Python Script 5:1 : : LocalNodeExecutionJob : Python Script : 5:1 : Python Script 5:1 Start execute2023-03-21 18:04:45,181 : INFO : Thread-2337 : : PythonKernel : Python Script : 5:1 : 1.5.22023-03-21 18:04:45,182 : INFO : Thread-2337 : : PythonKernel : Python Script : 5:1 : 3.9.15 | packaged by conda-forge | (main, Nov 22 2022, 08:55:37) 2023-03-21 18:04:45,182 : INFO : Thread-2337 : : PythonKernel : Python Script : 5:1 : [Clang 14.0.6 ]2023-03-21 18:04:45,242 : DEBUG : KNIME-Worker-304-Python Script 5:1 : : Node : Python Script : 5:1 : reset2023-03-21 18:04:45,244 : ERROR : KNIME-Worker-304-Python Script 5:1 : : Node : Python Script : 5:1 : Execute failed: AttributeError: 'KnimeExtensionArray' object has no attribute 'values'org.knime.python2.kernel.PythonIOException: AttributeError: 'KnimeExtensionArray' object has no attribute 'values' at org.knime.python3.scripting.nodes.AbstractPythonScriptingNodeModel.execute(AbstractPythonScriptingNodeModel.java:294) at org.knime.core.node.NodeModel.executeModel(NodeModel.java:549) at org.knime.core.node.Node.invokeFullyNodeModelExecute(Node.java:1267) at org.knime.core.node.Node.execute(Node.java:1041) at org.knime.core.node.workflow.NativeNodeContainer.performExecuteNode(NativeNodeContainer.java:595) at org.knime.core.node.exec.LocalNodeExecutionJob.mainExecute(LocalNodeExecutionJob.java:98) at org.knime.core.node.workflow.NodeExecutionJob.internalRun(NodeExecutionJob.java:201) at org.knime.core.node.workflow.NodeExecutionJob.run(NodeExecutionJob.java:117) at org.knime.core.util.ThreadUtils$RunnableWithContextImpl.runWithContext(ThreadUtils.java:367) at org.knime.core.util.ThreadUtils$RunnableWithContext.run(ThreadUtils.java:221) at java.base/java.util.concurrent.Executors$RunnableAdapter.call(Unknown Source) at java.base/java.util.concurrent.FutureTask.run(Unknown Source) at org.knime.core.util.ThreadPool$MyFuture.run(ThreadPool.java:123) at org.knime.core.util.ThreadPool$Worker.run(ThreadPool.java:246)Caused by: org.knime.python2.kernel.PythonIOException: Executing the Python script failed: Traceback (most recent call last): File "<string>", line 17, in <module> File "/Applications/KNIME 4.6.0.app/Contents/Eclipse/plugins/org.knime.python3_4.7.1.v202301311311/src/main/python/knime/api/table.py", line 343, in from_pandas return _backend.create_table_from_pandas(data, sentinel, row_ids=row_ids) File "/Applications/KNIME 4.6.0.app/Contents/Eclipse/plugins/org.knime.python3.arrow_4.7.1.v202301311311/src/main/python/knime/_arrow/_table.py", line 140, in create_table_from_pandas return _create_table_from_pandas(data, sentinel, row_ids) File "/Applications/KNIME 4.6.0.app/Contents/Eclipse/plugins/org.knime.python3.arrow_4.7.1.v202301311311/src/main/python/knime/_arrow/_table.py", line 125, in _create_table_from_pandas data = kap.pandas_df_to_arrow(data, row_ids=pandas_row_ids) File "/Applications/KNIME 4.6.0.app/Contents/Eclipse/plugins/org.knime.python3.arrow_4.7.1.v202301311311/src/main/python/knime/_arrow/_pandas.py", line 78, in pandas_df_to_arrow data_frame = _make_arrow_compatible(data_frame) File "/Applications/KNIME 4.6.0.app/Contents/Eclipse/plugins/org.knime.python3.arrow_4.7.1.v202301311311/src/main/python/knime/_arrow/_pandas.py", line 88, in _make_arrow_compatible schema = extract_knime_schema_from_df(data_frame) File "/Applications/KNIME 4.6.0.app/Contents/Eclipse/plugins/org.knime.python3.arrow_4.7.1.v202301311311/src/main/python/knime/_arrow/_pandas.py", line 150, in extract_knime_schema_from_df col_type = _resolve_object_type(df[col_name]) File "/Applications/KNIME 4.6.0.app/Contents/Eclipse/plugins/org.knime.python3.arrow_4.7.1.v202301311311/src/main/python/knime/_arrow/_pandas.py", line 164, in _resolve_object_type dtype = type(cleaned.iloc[0]) File "/Applications/KNIME 4.6.0.app/Contents/Eclipse/plugins/org.knime.pythonscripting.channel.v1.bin.macosx.x86_64_4.7.1.v202301201518/env/lib/python3.9/site-packages/pandas/core/indexing.py", line1073, in __getitem__ return self._getitem_axis(maybe_callable, axis=axis) File "/Applications/KNIME 4.6.0.app/Contents/Eclipse/plugins/org.knime.pythonscripting.channel.v1.bin.macosx.x86_64_4.7.1.v202301201518/env/lib/python3.9/site-packages/pandas/core/indexing.py", line1627, in _getitem_axis return self.obj._ixs(key, axis=axis) File "/Applications/KNIME 4.6.0.app/Contents/Eclipse/plugins/org.knime.pythonscripting.channel.v1.bin.macosx.x86_64_4.7.1.v202301201518/env/lib/python3.9/site-packages/pandas/core/series.py", line 959,in _ixs return self._values[i] File "/Applications/KNIME 4.6.0.app/Contents/Eclipse/plugins/org.knime.python3.arrow_4.7.1.v202301311311/src/main/python/knime/_arrow/_pandas.py", line 624, in __getitem__ storage = self._data.valuesAttributeError: 'KnimeExtensionArray' object has no attribute 'values' at org.knime.python3.scripting.Python3KernelBackend.beautifyPythonTraceback(Python3KernelBackend.java:687) at org.knime.python3.scripting.Python3KernelBackend.beautifyPythonTraceback(Python3KernelBackend.java:664) at org.knime.python3.scripting.Python3KernelBackend.executeAndCheckOutputs(Python3KernelBackend.java:595) at org.knime.python3.scripting.Python3KernelBackend.lambda$15(Python3KernelBackend.java:601) at org.knime.core.util.ThreadUtils$CallableWithContextImpl.callWithContext(ThreadUtils.java:383) at org.knime.core.util.ThreadUtils$CallableWithContext.call(ThreadUtils.java:269) at java.base/java.util.concurrent.FutureTask.run(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(Unknown Source) at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(Unknown Source) at java.base/java.lang.Thread.run(Unknown Source)Caused by: Traceback (most recent call last): File "<string>", line 17, in <module> File "/Applications/KNIME 4.6.0.app/Contents/Eclipse/plugins/org.knime.python3_4.7.1.v202301311311/src/main/python/knime/api/table.py", line 343, in from_pandas return _backend.create_table_from_pandas(data, sentinel, row_ids=row_ids) File "/Applications/KNIME 4.6.0.app/Contents/Eclipse/plugins/org.knime.python3.arrow_4.7.1.v202301311311/src/main/python/knime/_arrow/_table.py", line 140, in create_table_from_pandas return _create_table_from_pandas(data, sentinel, row_ids) File "/Applications/KNIME 4.6.0.app/Contents/Eclipse/plugins/org.knime.python3.arrow_4.7.1.v202301311311/src/main/python/knime/_arrow/_table.py", line 125, in _create_table_from_pandas data = kap.pandas_df_to_arrow(data, row_ids=pandas_row_ids) File "/Applications/KNIME 4.6.0.app/Contents/Eclipse/plugins/org.knime.python3.arrow_4.7.1.v202301311311/src/main/python/knime/_arrow/_pandas.py", line 78, in pandas_df_to_arrow data_frame = _make_arrow_compatible(data_frame) File "/Applications/KNIME 4.6.0.app/Contents/Eclipse/plugins/org.knime.python3.arrow_4.7.1.v202301311311/src/main/python/knime/_arrow/_pandas.py", line 88, in _make_arrow_compatible schema = extract_knime_schema_from_df(data_frame) File "/Applications/KNIME 4.6.0.app/Contents/Eclipse/plugins/org.knime.python3.arrow_4.7.1.v202301311311/src/main/python/knime/_arrow/_pandas.py", line 150, in extract_knime_schema_from_df col_type = _resolve_object_type(df[col_name]) File "/Applications/KNIME 4.6.0.app/Contents/Eclipse/plugins/org.knime.python3.arrow_4.7.1.v202301311311/src/main/python/knime/_arrow/_pandas.py", line 164, in _resolve_object_type dtype = type(cleaned.iloc[0]) File "/Applications/KNIME 4.6.0.app/Contents/Eclipse/plugins/org.knime.pythonscripting.channel.v1.bin.macosx.x86_64_4.7.1.v202301201518/env/lib/python3.9/site-packages/pandas/core/indexing.py", line1073, in __getitem__ return self._getitem_axis(maybe_callable, axis=axis) File "/Applications/KNIME 4.6.0.app/Contents/Eclipse/plugins/org.knime.pythonscripting.channel.v1.bin.macosx.x86_64_4.7.1.v202301201518/env/lib/python3.9/site-packages/pandas/core/indexing.py", line1627, in _getitem_axis return self.obj._ixs(key, axis=axis) File "/Applications/KNIME 4.6.0.app/Contents/Eclipse/plugins/org.knime.pythonscripting.channel.v1.bin.macosx.x86_64_4.7.1.v202301201518/env/lib/python3.9/site-packages/pandas/core/series.py", line 959,in _ixs return self._values[i] File "/Applications/KNIME 4.6.0.app/Contents/Eclipse/plugins/org.knime.python3.arrow_4.7.1.v202301311311/src/main/python/knime/_arrow/_pandas.py", line 624, in __getitem__ storage = self._data.valuesAttributeError: 'KnimeExtensionArray' object has no attribute 'values'2023-03-21 18:04:45,247 : DEBUG : KNIME-Worker-304-Python Script 5:1 : : WorkflowManager : Python Script : 5:1 : Python Script 5:1 doBeforePostExecution2023-03-21 18:04:45,247 : DEBUG : KNIME-Worker-304-Python Script 5:1 : : NodeContainer : Python Script : 5:1 : Python Script 5:1 has new state: POSTEXECUTE2023-03-21 18:04:45,249 : DEBUG : KNIME-Worker-304-Python Script 5:1 : : WorkflowManager : Python Script : 5:1 : Python Script 5:1 doAfterExecute - failure2023-03-21 18:04:45,251 : DEBUG : KNIME-Worker-304-Python Script 5:1 : : Node : Python Script : 5:1 : reset2023-03-21 18:04:45,254 : DEBUG : KNIME-Worker-304-Python Script 5:1 : : Node : Python Script : 5:1 : clean output ports.2023-03-21 18:04:45,255 : DEBUG : KNIME-Worker-304-Python Script 5:1 : : WorkflowDataRepository : Python Script : 5:1 : Removing handler 8e29199b-f434-4d32-a892-d96ad8ae7b07 (Python Script 5:1:<no directory>) - 16 remaining2023-03-21 18:04:45,255 : DEBUG : KNIME-Worker-304-Python Script 5:1 : : NodeContainer : Python Script : 5:1 : Python Script 5:1 has new state: IDLE2023-03-21 18:04:45,258 : DEBUG : KNIME-Worker-304-Python Script 5:1 : : Node : Python Script : 5:1 : Configure succeeded. (Python Script)2023-03-21 18:04:45,258 : DEBUG : KNIME-Worker-304-Python Script 5:1 : : NodeContainer : Python Script : 5:1 : Python Script 5:1 has new state: CONFIGURED2023-03-21 18:04:45,259 : DEBUG : KNIME-Worker-304-Python Script 5:1 : : NodeContainer : Python Script : 5:1 : kn_forum_63705_pandas_duplicates_error 5 has new state: CONFIGURED2023-03-21 18:04:45,754 : DEBUG : python-kernel-creator : : DefaultPythonGateway : : : Connected to Python process with PID: 18444 after ms: 11792023-03-21 18:04:48,547 : DEBUG : main : : WorkflowEditPartFactory : : : Deactivate org.knime.workbench.editor.context2023-03-21 18:04:48,547 : DEBUG : main : : WorkflowEditPartFactory : : : Deactivate org.knime.workbench.editor.context2023-03-21 18:04:48,547 : DEBUG : main : : WorkflowEditPartFactory : : : Deactivate org.knime.workbench.editor.context2023-03-21 18:04:48,547 : DEBUG : main : : WorkflowEditPartFactory : : : Deactivate org.knime.workbench.editor.context2023-03-21 18:04:48,547 : DEBUG : main : : WorkflowEditPartFactory : : : Deactivate org.knime.workbench.editor.context2023-03-21 18:04:48,547 : DEBUG : main : : WorkflowEditPartFactory : : : Deactivate org.knime.workbench.editor.context2023-03-21 18:04:48,547 : DEBUG : main : : WorkflowEditPartFactory : : : Deactivate org.knime.workbench.editor.context2023-03-21 18:04:48,547 : DEBUG : main : : WorkflowEditPartFactory : : : Deactivate org.knime.workbench.editor.context2023-03-21 18:04:48,547 : DEBUG : main : : WorkflowEditPartFactory : : : Deactivate org.knime.workbench.editor.context2023-03-21 18:04:48,547 : DEBUG : main : : WorkflowEditPartFactory : : : Deactivate org.knime.workbench.editor.context2023-03-21 18:04:48,547 : DEBUG : main : : WorkflowEditPartFactory : : : Deactivate org.knime.workbench.editor.context2023-03-21 18:04:48,547 : DEBUG : main : : WorkflowEditPartFactory : : : Deactivate org.knime.workbench.editor.context2023-03-21 18:04:48,547 : DEBUG : main : : WorkflowEditPartFactory : : : Deactivate org.knime.workbench.editor.context2023-03-21 18:04:48,547 : DEBUG : main : : WorkflowEditPartFactory : : : Deactivate org.knime.workbench.editor.context2023-03-21 18:04:48,547 : DEBUG : main : : WorkflowEditPartFactory : : : Deactivate org.knime.workbench.editor.context2023-03-21 18:04:48,547 : DEBUG : main : : WorkflowEditPartFactory : : : Deactivate org.knime.workbench.editor.context2023-03-21 18:04:48,547 : DEBUG : main : : WorkflowEditPartFactory : : : Deactivate org.knime.workbench.editor.context2023-03-21 18:04:48,547 : DEBUG : main : : WorkflowEditPartFactory : : : Deactivate org.knime.workbench.editor.context2023-03-21 18:04:48,547 : DEBUG : main : : WorkflowEditPartFactory : : : Deactivate org.knime.workbench.editor.context2023-03-21 18:04:48,547 : DEBUG : main : : WorkflowEditPartFactory : : : Deactivate org.knime.workbench.editor.context2023-03-21 18:04:48,547 : DEBUG : main : : WorkflowEditPartFactory : : : Deactivate org.knime.workbench.editor.context2023-03-21 18:04:48,547 : DEBUG : main : : WorkflowEditPartFactory : : : Deactivate org.knime.workbench.editor.context2023-03-21 18:04:48,548 : DEBUG : main : : WorkflowEditPartFactory : : : Deactivate org.knime.workbench.editor.context with .drop_duplicates()Node 2Node 3v_path_parquet_filelocate and create/data/ folderwith absolute pathsdf_export_from_knime.parquetv_path_parquet_filewithout .drop_duplicates()Python Script Table Creator GroupBy Java EditVariable (simple) Collect LocalMetadata Parquet Reader String to Path(Variable) Python Script

Nodes

Extensions

Links

Download

To use this workflow in KNIME, download it from the below URL and open it in KNIME:

Download Workflow
Created by: steffen
Created at: 2023-03-21
On NodePit since: 2023-03-22
Last update: 2024-04-27
Created with KNIME version: v4.7.1

Deploy, schedule, execute, and monitor your KNIME workflows locally, in the cloud or on-premises – with our brand new NodePit Runner.

Try NodePit Runner!