This is the second workflow in the PubChem Big Data story.
In the top part of the workflow we pivot the assay data using KNIME Extension for Apache Spark. We save two files: pivoted matrix and IDs of the compounds (CIDs) in this matrix.
In the bottom part (optional) we extract additional information on the data.
AWS Autentication component, Paths to Livy and S3 component, and Create Spark Contex (Livy) node require configuration.
To use this workflow in KNIME, download it from the below URL and open it in KNIME:
Download WorkflowDeploy, schedule, execute, and monitor your KNIME workflows locally, in the cloud or on-premises – with our brand new NodePit Runner.
Try NodePit Runner!Do you have feedback, questions, comments about NodePit, want to support this platform, or want your own nodes or workflows listed here as well? Do you think, the search results could be improved or something is missing? Then please get in touch! Alternatively, you can send us an email to mail@nodepit.com.
Please note that this is only about NodePit. We do not provide general support for KNIME — please use the KNIME forums instead.