Spark Sorter

This node sorts the rows according to user-defined criteria. In the dialog, select the columns according to which the data should be sorted. Also select whether it should be sorted in ascending or descending order.


Add columns
If you want to extend the sorting criteria to a higher number of columns as displayed, set the number of columns at the bottom and click 'new columns' to add them to the dialog.
Move Missing Cells to end of sorted list
If selected missing values are always placed at the end of the sorted output. This is independent of the sort order, i.e. if sorted ascendingly they are considered to be larger than a non-missing value and if sorted descendingly they are smaller than any non-missing value.

Input Ports

Spark DataFrame/RDD to be sorted.

Output Ports

A sorted Spark DataFrame/RDD.


This node has no views




You want to see the source code for this node? Click the following button and we’ll use our super-powers to find it for you.