Generates for each row of a given input table a bit vector. The bit vectors are either generated from multiple numerical or string columns, a string column containing the bit positions to set, hexadecimal or binary strings or a collection column. In order to adjust the node settings please select first the source column object e.g. if the bit vector should be created from multiple string/numerical columns or from a single string/collection column. Depending on the selected option the corresponding dialog elements are enabled.

Bit vectors from multiple columns

In the case of multiple columns the bit positions in the resulting bit vector correspond to the column position in the input table. For example if the second and third column of a given input table is selected and the first column is omitted the bit vectors of each row will have length 2. The first bit of the bit vector is set if the value of the second column matches the selected criterion likewise the second bit of the bit vector is set if the value of the third column matches the selected criterion. The columns to consider when creating the bit vector can be specified in the multiple column selection section. Using the enforce exclusion/inclusion option the node can be configured to handle previously unknown columns. If the enforce exclusion option is selected all unknown columns are added automatically to the include list whereas if the enforce inclusion option is selected all unknown columns are added to the exclude list. The columns to include can be also defined by a pattern if the Wildcard/Regex Selection option is selected.

Multiple string columns

The bit of a vector is set if the corresponding column value does match/does not match the specified pattern depending on the "Set bit if pattern does match/does not match" option. The pattern may contain wildcards such as '?' or '*' to match any one character or any sequence (including none) of characters. It can also be a complex regular expression.

Multiple numeric columns

There are two options to determine if the bit is set for the value in the corresponding column or not:

• either a global threshold is defined, then all values which are above or equal to the threshold are converted into set bits, all other bit positions remain 0, or
• a certain percentage of the mean of each column is used as a threshold, then all values which are above or equal to the percentage of the mean are converted into set bits. As an example let's say the mean percentage is set to 50% and the mean of col1 is 2 and the mean of col2 is 8. Then the corresponding bit for col1 is set if the value is above or equal to 1 and for col2 if the value is above or equal to 4.

Bit vectors from a single column

In the case of a single input column only the selected single column to be parsed is considered for the generation of the bit vectors.

Single string column

In the case of a string input only the column containing the string is considered for the generation of the bit vectors. The string is parsed and converted into a bit vector. There are three valid input formats which can be parsed and converted:

• Hexadecimal strings: strings consisting only of the characters 0-9 and A - F (where lower- or uppercase is not important). The represented hexadecimal number is converted into a binary number which is represented by the resulting bit vector.
• Binary strings: strings consisting only of 0s and 1s are parsed and converted into the according bit vectors.
• ID strings: strings consisting of numbers (separated by spaces) where the numbers refer to those positions in the bit vector which should be set. (Typical input format for association rule mining).

Single collection column

In the case of a single collection column each unique collection element gets a bit position assigned. The length of the bit vectors corresponds to the number of unique elements in a collection cells. For example if the input table contains two rows with the collections {a,b} and {b,c} the corresponding bit vectors will be [110] and [011].

Missing values

For numeric data the incoming missing values will result in 0s. For multiple string columns a missing values will also result in 0s. For the string input missing values will also result in a missing value in the output table. If a string could not be parsed it will also result in a missing cell in the output table and an error message with detailed information is printed in the console. For a collection column all missing collection elements are ignored.

Options

Create bit vectors from multiple string columns

Pattern

The pattern to search for in the data value

Contains wildcards

Select this option to use wild cards in the pattern. Wildcard patterns contain '*' (matching any sequence of characters) and '?' (matching any one character).

Regular expression

Select this option to specify a regular expression. Examples of regular expressions are given below. "^foo.*" matches anything that starts with "foo". The '^'-character stands for the beginning of the word, the dot matches any (one) character, and the asterisk allows any number (including zero) of the previous character.
"[0-9]*" matches any string of digits (including the empty string). The [ ] define a set of characters (they could be added individually like [0123456789], or by range). This set matches any (one) character included in the set.
For a complete explanation of regular expressions see e.g. the JavaDoc of the java.util.regex.Pattern class.

Case sensitive match

A case sensitive matching is performed if this option is selected.

Set bit if pattern

Depending on the selected option the corresponding bit in the bit vector is set if the pattern either does match or does not match

Multiple column selection panel

Select the string columns to convert to a bit vector

Create bit vectors from multiple numeric columns

Threshold

If the "numeric input" is checked, specify the global threshold. All values which are above or equal to this threshold will result in a 1 in the bit vector.

Use percentage of the mean

Check, if a percentage of the mean of each column should serve as threshold above which the bits are set.

Percentage

Specify which percentage of the mean a value should have in order to be set.

Multiple column selection panel

Select the numeric columns to convert to a bit vector

Create bit vectors from a single string column

Kind of string representation

Select one of the three valid input formats: HEX (hexadecimal), ID (bit positions) or BIT (binary strings). See description above.

Single column to be parsed

The string column to parse

Create bit vectors from a single collection column

Single column to be parsed

The collection column to parse

General options

Remove column(s) used for bit vector creation:

If it is checked the generating column(s) (included columns if numeric input was used or the selected string column) are removed. If it is unchecked the generated bit vectors are appended to the input table.

Output column

Name of the output column.

Fail on invalid input

If selected, the node will fail during execution if a data cell could not be converted to a bit set. If unselected, the node will skip these invalid entries and insert a missing value instead.

Bit vector type

The dense vector type stores is the default method that stores each vector position with a single bit thus requiring the same amount of bits for all vectors e.g. the vector length in bits. The sparse vector type stores only the indices of the set bits thus depends the space required to store a bit vector depends on the number of set bits. Each set bit requires between 32 and 64 bits depending on the operating system. Therefore the sparse option should be only selected if the majority of the bit vectors contain only few set bits e.g. less than 10%.

Input Ports

Data table with numerical data or a string column to be parsed.

Output Ports

Data table with the generated bit vectors.

Views

Statistics View

Provides information about the generation of the bit vectors from the data. In particular this is the number of processed rows, the total number of generated zeros and ones and the resulting ratio of 1s to 0s.

Best Friends (Incoming)

• File Reader (12 %) Streamable
• CSV Reader (8 %) 
• Excel Reader (XLS) (7 %) Streamable
• Column Filter (7 %) Streamable
• Pivoting (5 %) 
• One to Many (4 %) 
• GroupBy (4 %) 
• Cell Splitter (3 %) Deprecated
• Create Collection Column (2 %) Streamable
• Missing Value (2 %) 
• Column Rename (2 %) Streamable
• Association Rule Learner (2 %) 
• Number To String (2 %) Deprecated
• Column Combiner (1 %) Streamable
• Row Filter (1 %) Streamable
• String Replacer (1 %) Streamable
• XLS Reader (1 %) Deprecated
• Joiner (1 %) 
• Database Reader (legacy) (< 1 %) 
• String To Number (< 1 %) StreamableDeprecated
• Normalizer (< 1 %) 
• Rule-based Row Filter (< 1 %) Streamable
• Rule Engine (< 1 %) Streamable
• Table Creator (< 1 %) 
• Auto-Binner (< 1 %) 
• Create Bit Vector (< 1 %) 
• Column Merger (< 1 %) Streamable
• ARFF Reader (< 1 %) 
• Java Snippet (< 1 %) Streamable
• Expand Bit Vector (< 1 %) 
• Column Aggregator (< 1 %) Streamable
• Column Appender (< 1 %) Streamable
• Partitioning (< 1 %) 
• Transpose (< 1 %) 
• Excel Reader (XLS) (< 1 %) StreamableDeprecated
• Category To Class (< 1 %) 
• Strings To Document (< 1 %) Streamable
• Fingerprint Similarity (< 1 %) 
• Table Reader (< 1 %) Streamable
• Group Loop Start (< 1 %) 
• Fuzzy Rule Learner (< 1 %) 
• Scorer (< 1 %) 
• Category To Number (< 1 %) Streamable
• Column Rename (Regex) (< 1 %) Streamable
• Column Resorter (< 1 %) Streamable
• Constant Value Column (< 1 %) Streamable
• Constant Value Column Filter (< 1 %) 
• RowID (< 1 %) Streamable
• Row Sampling (< 1 %) 
• Column Splitter (< 1 %) Streamable
• String Manipulation (< 1 %) Streamable
• Math Formula (< 1 %) Streamable
• Java Snippet (simple) (< 1 %) 
• Punctuation Erasure (< 1 %) Streamable
• Bag Of Words Creator (< 1 %) 
• Document vector (< 1 %) Deprecated
• Document Vector (< 1 %) 
• BitSetToColumns (< 1 %) 
• Fingerprinter (< 1 %) 
• CDK to Molecule (< 1 %) 
• Fingerprints (< 1 %) 
• RDKit Molecule Substructure Filter (< 1 %) 
• RDKit Substructure Counter (< 1 %) 
• Fingerprint Clustering (< 1 %) 
• Substructure Match Counter (< 1 %) 
• Substructure Matcher (< 1 %) 
• Fingerprint (< 1 %) 
• Convert Bitvector to FingerPrint (< 1 %) 
• Convert Fingerprint to Table (< 1 %) 
• Chemical Fingerprint (< 1 %) Streamable
• MarvinSketch (< 1 %) 
• MolConverter (< 1 %) Streamable
• Split Collection Column (< 1 %) 
• Database Connection Table Reader (legacy) (< 1 %) 
• Database Looping (legacy) (< 1 %) 
• Loop End (Column Append) (< 1 %) 
• Loop End (< 1 %) 
• Counting Loop Start (< 1 %) 
• k-Means (< 1 %) Deprecated
• k-Means (< 1 %) 
• SMOTE (< 1 %) 
• Concatenate (< 1 %) Streamable
• Auto-Binner (Apply) (< 1 %) Streamable
• Numeric Binner (< 1 %) Streamable
• Create Byte Vector (< 1 %) 
• Expand Byte Vector (< 1 %) 
• Cell Splitter By Position (< 1 %) Streamable
• Number To Category (Apply) (< 1 %) 
• Column to Grid (< 1 %) 
• Create Table Structure (< 1 %) 
• Table Validator (< 1 %) 
• Domain Calculator (< 1 %) 
• Edit Nominal Domain (< 1 %) 
• Reference Column Filter (< 1 %) Streamable
• Missing Value Column Filter (< 1 %) 
• Nominal Value Row Filter (< 1 %) Streamable
• Row Splitter (< 1 %) Streamable
• Reference Row Filter (< 1 %) 
• Subset Matcher (< 1 %) 
• Normalizer (Apply) (< 1 %) Streamable
• One to Many (PMML) (< 1 %) 
• Number To String (PMML) (< 1 %) Deprecated
• Reference Column Resorter (< 1 %) Streamable
• Sorter (< 1 %) 
• String Replace (Dictionary) (< 1 %) Streamable
• Ungroup (< 1 %) Streamable
• Unpivoting (< 1 %) 
• Rule-based Row Splitter (< 1 %) Streamable
• Statistics (< 1 %) 
• CASE Switch Data (Start) (< 1 %) 
• Color Manager (< 1 %) 
• Molecule Type Cast (< 1 %) Streamable
• SDF Reader (< 1 %) 
• Distance Matrix Calculate (< 1 %) 
• Association Rule Learner (Borgelt) (< 1 %) 
• Math Formula (Multi Column) (< 1 %) Streamable
• Read Excel Sheet Names (XLS) (< 1 %) 
• Category To Class (< 1 %) 
• Case Converter (< 1 %) Streamable
• Stop Word Filter (< 1 %) StreamableDeprecated
• Bag of Words Creator (< 1 %) Deprecated
• Document Data Extractor (< 1 %) 
• Document vector hashing (< 1 %) StreamableDeprecated
• Term Vector (< 1 %) 
• Table View (< 1 %) 
• MongoDB Reader (< 1 %) 
• Python Script (1⇒1) (< 1 %) 
• R Snippet (< 1 %) 
• Fingerprint Similarity (< 1 %) 
• RDKit Fingerprint (< 1 %) Streamable
• Show all 130 recommendations

Best Friends (Outgoing)

• Association Rule Learner (39 %) 
• Association Rule Learner (Borgelt) (6 %) 
• Item Set Finder (Borgelt) (5 %) 
• Expand Bit Vector (4 %) 
• Column Filter (2 %) Streamable
• Similarity Search (2 %) 
• Distance Matrix Calculate (2 %) 
• Partitioning (2 %) 
• WrappedNode Output (1 %) 
• Joiner (1 %) 
• Create Collection Column (< 1 %) Streamable
• Create Bit Vector (< 1 %) 
• Row Filter (< 1 %) Streamable
• GroupBy (< 1 %) 
• Column Rename (< 1 %) Streamable
• Bit Vector Distances (< 1 %) 
• X-Partitioner (< 1 %) 
• Hierarchical Cluster Assigner (< 1 %) 
• Hierarchical Cluster View (< 1 %) 
• Create Byte Vector (< 1 %) 
• Reference Row Filter (< 1 %) 
• Subset Matcher (< 1 %) 
• CSV Writer (< 1 %) Streamable
• Hierarchical Clustering (DistMatrix) (< 1 %) 
• k-Means (< 1 %) 
• Decision Tree Learner (< 1 %) 
• SVM Learner (< 1 %) 
• Column Appender (< 1 %) Streamable
• Row Splitter (< 1 %) Streamable
• RowID (< 1 %) Streamable
• Transpose (< 1 %) 
• Value Counter (< 1 %) 
• Histogram (local) (< 1 %) 
• Interactive Table (local) (< 1 %) 
• Table to H2O (< 1 %) 
• PPilot Connector (< 1 %) 
• Apriori (3.7) (< 1 %) 
• Fingerprint Similarity (< 1 %) 
• RDKit Diversity Picker (< 1 %) 
• Tautomer Generator (< 1 %) 
• Fingerprint Similarity (< 1 %) 
• Data to Report (< 1 %) 
• Convert Bitvector to FingerPrint (< 1 %) 
• Fingerprint to Hexadecimal String (< 1 %) Streamable
• Fingerprint FOLD (< 1 %) Streamable
• Fingerprint Properties (< 1 %) StreamableDeprecated
• Fast Tanimoto (< 1 %) 
• Fingerprints Expander (< 1 %) 
• Fingerprint Similarity (< 1 %) 
• Byte Vector Distances (< 1 %) 
• Database Update (legacy) (< 1 %) 
• Table Writer (< 1 %) 
• Java Snippet (< 1 %) Streamable
• Loop End (< 1 %) 
• Counting Loop Start (< 1 %) 
• Chunk Loop Start (< 1 %) 
• Group Loop Start (< 1 %) 
• Recursive Loop Start (< 1 %) 
• Naive Bayes Learner (< 1 %) Deprecated
• Fuzzy Rule Learner (< 1 %) 
• Cluster Assigner (< 1 %) Streamable
• Fuzzy c-Means (< 1 %) 
• Hierarchical Clustering (< 1 %) 
• DBSCAN (< 1 %) 
• K Nearest Neighbor (< 1 %) StreamableDeprecated
• MDS (< 1 %) 
• PCA (< 1 %) Deprecated
• Polynomial Regression Learner (< 1 %) 
• Random Forest Learner (< 1 %) Deprecated
• Random Forest Learner (< 1 %) Deprecated
• Random Forest Learner (Regression) (< 1 %) 
• Random Forest Predictor (< 1 %) StreamableDeprecated
• Random Forest Predictor (Regression) (< 1 %) Streamable
• Cell Splitter (< 1 %) Deprecated
• String To Number (< 1 %) StreamableDeprecated
• Column Merger (< 1 %) Streamable
• Column Resorter (< 1 %) Streamable
• One to Many (< 1 %) 
• Constant Value Column (< 1 %) Streamable
• Linear Correlation (< 1 %) 
• Domain Calculator (< 1 %) 
• Double To Int (< 1 %) StreamableDeprecated
• Filter Apply Row Splitter (< 1 %) Streamable
• Normalizer (< 1 %) 
• Pivoting (< 1 %) 
• String To Number (PMML) (< 1 %) Deprecated
• Rank (< 1 %) 
• Numeric Row Splitter (< 1 %) 
• Row Sampling (< 1 %) 
• Set Operator (< 1 %) 
• Sorter (< 1 %) 
• Column Splitter (< 1 %) Streamable
• String Manipulation (< 1 %) Streamable
• Rank Correlation (< 1 %) 
• CASE Switch Data (Start) (< 1 %) 
• HiLite Table (local) (< 1 %) 
• Parallel Coordinates (local) (< 1 %) 
• Scatter Plot (local) (< 1 %) 
• Scatter Matrix (local) (< 1 %) 
• Color Manager (< 1 %) 
• Molecule Type Cast (< 1 %) Streamable
• Fingerprint Bayesian Learner (< 1 %) 
• Fingerprint Bayesian Predictor (< 1 %) 
• MISSING Association Rule Learner (Borgelt) (< 1 %) 
• Random Item Inserter (< 1 %) 
• Numeric Distances (< 1 %) 
• k-Medoids (< 1 %) 
• K Nearest Neighbor (Distance Function) (< 1 %) Deprecated
• Universe Marker (< 1 %) 
• Math Formula (< 1 %) Streamable
• Excel Writer (XLS) (< 1 %) 
• Java Snippet (simple) (< 1 %) 
• Java Snippet Row Splitter (< 1 %) Streamable
• Category To Class (< 1 %) 
• Stop Word Filter (< 1 %) Streamable
• Document Data Extractor (< 1 %) 
• FPGrowth (3.7) (< 1 %) 
• HotSpot (3.7) (< 1 %) 
• Image to DataRow (< 1 %) Streamable
• Python Script (1⇒1) (< 1 %) 
• RDKit Fingerprint (< 1 %) Streamable
• WebSearcher (< 1 %) Deprecated
• Show all 122 recommendations

Workflows

• 02_​Working_​with_​Collection_​Supported_​Nodes
• 07_​RDKit_​with_​Java_​Snippet_​Example
• 003004_​CollectionCookbook_​blog
• baza_​danych_​PP_​4.7
• 02_​Working_​with_​Collection_​Supported_​Nodes
• 07_​RDKit_​with_​Java_​Snippet_​Example
• Show all 6 workflows

Installation

To use this node in KNIME, install KNIME Base Nodes from the following update site: