Remote Connection
Target Nodes
Amazon S3 File PickerAvro to SparkAvro to SparkAzure Blob Store File PickerCall Workflow (Table Based)- Call Workflow Service
Call Workflow Service- Capture Workflow End
- Capture Workflow Start
- CASE Switch Start
- Configurable Crossover (Flow Variable Value)
- Configurable Empty Table Switch
- Configurable IF/CASE Switch
- Configurable IF/CASE Switch (Flow Variable Value)
- Counting Loop Start
Create DirectoryCreate Spark Context (Livy)CSV to SparkCSV to SparkDB LoaderDelete FilesDeploy Workflow to ServerDeploy Workflow to ServerDownloadDownloadDownload / Upload from ListDownload / Upload from List- Generic Loop Start
Google Cloud Storage File PickerHDFS File PermissionHive Loader (legacy)- Image Reader (Table) Remote
Impala Loader (legacy)Input Directory- Interval Loop Start
JSON to SparkJSON to SparkList Remote Files- NoOp (Configurable)
NoOp (Configurable)ORC ReaderORC to SparkORC to SparkORC WriterParquet ReaderParquet to SparkParquet to SparkParquet WriterPython Script (Hive)- Reference DB Table Exists IF Switch
Spark to AvroSpark to CSVSpark to JSONSpark to ORCSpark to ParquetSpark to TextText to SparkText to SparkUploadUpload- Variable Filter
- Workflow Executor
- Workflow Input
- Workflow Output
