Icon

02_​Example_​for_​Reading_​a_​List_​of_​Files

Reading multiple files using loops

This workflow demonstrates how to read multiple files using a loop.

Reading multiple files using loops This workflow demonstrates how to read multiple files using a loop. The files arecontained in a zip file (located in the meta node). They are then extracted into a tempfolder and the temp folder is indexed. The list of files is passed into the loop, whichreads one file at a time (all files have the same file structure, just different data) andthe output is concatenated in the loop end node. This meta node creates a folder inthe temp space and puts a couple of files into it. The flow variableoutput denotes the path to this temporary folder(This meta node is usually not needed- it's only to make this workflow workon any system.)for each fileThis reads thefile from the currentvariable, prefixing rows. Note, the files all needto have the same structure/columns. If they don't you need to do extra work (use CSV Reader then)just concatenates.The "uniquify" optionis disable as we assert uniquerowIDs in the loopthis determines therow prefix in the filereader, e.g. File-x-Row12Create ExampleFiles in Temp Table Row ToVariable Loop Start File Reader Loop End Java Edit Variable List Files Reading multiple files using loops This workflow demonstrates how to read multiple files using a loop. The files arecontained in a zip file (located in the meta node). They are then extracted into a tempfolder and the temp folder is indexed. The list of files is passed into the loop, whichreads one file at a time (all files have the same file structure, just different data) andthe output is concatenated in the loop end node. This meta node creates a folder inthe temp space and puts a couple of files into it. The flow variableoutput denotes the path to this temporary folder(This meta node is usually not needed- it's only to make this workflow workon any system.)for each fileThis reads thefile from the currentvariable, prefixing rows. Note, the files all needto have the same structure/columns. If they don't you need to do extra work (use CSV Reader then)just concatenates.The "uniquify" optionis disable as we assert uniquerowIDs in the loopthis determines therow prefix in the filereader, e.g. File-x-Row12Create ExampleFiles in Temp Table Row ToVariable Loop Start File Reader Loop End Java Edit Variable List Files

Nodes

Extensions

Links