Icon

log_​file_​analysis

Here I filter down category facets to get clean URLs in order to extract number of request sent from Googlebot Here I extract the faceted categories in order to count number of request sent from googlebot to non-indexable facets Here I filter down product parameters to get clean URLs in order to extract number of request sent from Googlebot Here I extract the product with parameters in order to count number of request sent from googlebot to non-indexable facets Here I filter down content parameters to get clean URLs in order to extract number of request sent from Googlebot Here I extract the content with parameters in order to count number of request sent from googlebot to non-indexable facets Here I filter out every URL not containing askmobile in order to extract number of request sent from Googlebot Here I filter out every URL not containing askmobile in order to extract number of request sent from Googlebot Here I include only 4xx and 5xx request in order to extract number of request sent from Googlebot to broken links *note that you can insert any table from above to see how many clean URLs have broken links* Here I exclude all indexable pages in order to extract number of request sent from Googlebot to non-indexable pages Use these nodes for line graph Use this section to view line graphs from seprate user-agents Database CSV/XLS to JSON Coverter Node 1filter_out_unecessary_elementsNode 3crawl_statsinclude_facetsexclude_facetsfilter_out_ENTFERNENchange_?_to_ENTFERNENnumber_of_request_per_pagenumber _of_request_per_pagenumber_of_requestnumber_of_requestcrawl_statsNode 14Node 15crawl_statsnumber_of_requestnumber _of_request_per_pageexclude_parameterschange_?_to_ENTFERNENfilter_out_ENTFERNENfilter_out_resource_requestfilter_out_resource_requestcrawl_statsnumber_of_requestnumber_of_request_per_pagechange_?_to_ENTFERNENfilter_out_ENTFERNENchange_?_to_ENTFERNENnumber _of_request_per_pagenumber_of_requestfilter_out_resource_requestcrawl_statsNode 35Node 36exclude_parameterschange_?_to_ENTFERNENfilter_out_htmlcrawl_statsnumber_of_requestnumber_of_request_per_pagechange_ENTFERNEN_to_?filter_out_ENTFERNENchange_?_to_ENTFERNENfilter_out_ENTFERNENNode 47filter_out_unecessary_elementsinclude_onlyaskmobile_directoryexclude_dynaTrace_directorycrawl_statsnumber_of_requestnumber_of_request_per_pagenumber_of_requestinclude_only_dynaTraceMonitor_directorynumber_of_request_per_pagecrawl_statsfilter_out_unecessary_elementsNode 60Node 62Node 64include_only_5xx_source_codefilter_out_unecessary_elementscrawl_statsnumber_of_requestNode 70include_only_4xx_source_codecrawl_statsnumber_of_requestNode 75filter_out_unecessary_elementsinclude_only_dynaTraceMonitor_directorycrawl_statsnumber_of_requestnumber_of_request_per_pageNode 81total_crawlbudgetNode 84Node 85Node 86Node 87Node 88Node 89Node 90Node 91Googlebot DesktopGooglebot Smartphone File Reader Column Filter Table to JSON GroupBy Rule-basedRow Filter Rule-basedRow Filter Row Filter String Manipulation GroupBy GroupBy GroupBy GroupBy GroupBy File Reader Column Filter GroupBy GroupBy GroupBy Rule-basedRow Filter String Manipulation Row Filter Row Filter Row Filter GroupBy GroupBy GroupBy String Manipulation Row Filter String Manipulation GroupBy GroupBy Row Filter GroupBy Column Filter File Reader Rule-basedRow Filter String Manipulation Row Filter GroupBy GroupBy GroupBy String Manipulation Row Filter String Manipulation Row Filter File Reader Column Filter Row Filter Row Filter GroupBy GroupBy GroupBy GroupBy Row Filter GroupBy GroupBy Column Filter File Reader Row Splitter Line Plot(JavaScript) Row Filter Column Filter GroupBy GroupBy File Reader Row Filter GroupBy GroupBy File Reader Column Filter Row Filter GroupBy GroupBy GroupBy GroupBy GroupBy File Reader JSON Row Combiner Row Filter Group Loop Start ConstantValue Column Loop End JSON Writer Row Splitter Line Plot(JavaScript) Line Plot(JavaScript) Here I filter down category facets to get clean URLs in order to extract number of request sent from Googlebot Here I extract the faceted categories in order to count number of request sent from googlebot to non-indexable facets Here I filter down product parameters to get clean URLs in order to extract number of request sent from Googlebot Here I extract the product with parameters in order to count number of request sent from googlebot to non-indexable facets Here I filter down content parameters to get clean URLs in order to extract number of request sent from Googlebot Here I extract the content with parameters in order to count number of request sent from googlebot to non-indexable facets Here I filter out every URL not containing askmobile in order to extract number of request sent from Googlebot Here I filter out every URL not containing askmobile in order to extract number of request sent from Googlebot Here I include only 4xx and 5xx request in order to extract number of request sent from Googlebot to broken links *note that you can insert any table from above to see how many clean URLs have broken links* Here I exclude all indexable pages in order to extract number of request sent from Googlebot to non-indexable pages Use these nodes for line graph Use this section to view line graphs from seprate user-agents Database CSV/XLS to JSON Coverter Node 1filter_out_unecessary_elementsNode 3crawl_statsinclude_facetsexclude_facetsfilter_out_ENTFERNENchange_?_to_ENTFERNENnumber_of_request_per_pagenumber _of_request_per_pagenumber_of_requestnumber_of_requestcrawl_statsNode 14Node 15crawl_statsnumber_of_requestnumber _of_request_per_pageexclude_parameterschange_?_to_ENTFERNENfilter_out_ENTFERNENfilter_out_resource_requestfilter_out_resource_requestcrawl_statsnumber_of_requestnumber_of_request_per_pagechange_?_to_ENTFERNENfilter_out_ENTFERNENchange_?_to_ENTFERNENnumber _of_request_per_pagenumber_of_requestfilter_out_resource_requestcrawl_statsNode 35Node 36exclude_parameterschange_?_to_ENTFERNENfilter_out_htmlcrawl_statsnumber_of_requestnumber_of_request_per_pagechange_ENTFERNEN_to_?filter_out_ENTFERNENchange_?_to_ENTFERNENfilter_out_ENTFERNENNode 47filter_out_unecessary_elementsinclude_onlyaskmobile_directoryexclude_dynaTrace_directorycrawl_statsnumber_of_requestnumber_of_request_per_pagenumber_of_requestinclude_only_dynaTraceMonitor_directorynumber_of_request_per_pagecrawl_statsfilter_out_unecessary_elementsNode 60Node 62Node 64include_only_5xx_source_codefilter_out_unecessary_elementscrawl_statsnumber_of_requestNode 70include_only_4xx_source_codecrawl_statsnumber_of_requestNode 75filter_out_unecessary_elementsinclude_only_dynaTraceMonitor_directorycrawl_statsnumber_of_requestnumber_of_request_per_pageNode 81total_crawlbudgetNode 84Node 85Node 86Node 87Node 88Node 89Node 90Node 91Googlebot DesktopGooglebot Smartphone File Reader Column Filter Table to JSON GroupBy Rule-basedRow Filter Rule-basedRow Filter Row Filter String Manipulation GroupBy GroupBy GroupBy GroupBy GroupBy File Reader Column Filter GroupBy GroupBy GroupBy Rule-basedRow Filter String Manipulation Row Filter Row Filter Row Filter GroupBy GroupBy GroupBy String Manipulation Row Filter String Manipulation GroupBy GroupBy Row Filter GroupBy Column Filter File Reader Rule-basedRow Filter String Manipulation Row Filter GroupBy GroupBy GroupBy String Manipulation Row Filter String Manipulation Row Filter File Reader Column Filter Row Filter Row Filter GroupBy GroupBy GroupBy GroupBy Row Filter GroupBy GroupBy Column Filter File Reader Row Splitter Line Plot(JavaScript) Row Filter Column Filter GroupBy GroupBy File Reader Row Filter GroupBy GroupBy File Reader Column Filter Row Filter GroupBy GroupBy GroupBy GroupBy GroupBy File Reader JSON Row Combiner Row Filter Group Loop Start ConstantValue Column Loop End JSON Writer Row Splitter Line Plot(JavaScript) Line Plot(JavaScript)

Nodes

Extensions

Links

Download

To use this workflow in KNIME, download it from the below URL and open it in KNIME:

Download Workflow
Created by: lance19kt
Created at: 2019-10-02
On NodePit since: 2019-10-04
Last update: 2024-04-20
Created with KNIME version: v3.7.2
NodePit Exclusive Only available on NodePit

Deploy, schedule, execute, and monitor your KNIME workflows locally, in the cloud or on-premises – with our brand new NodePit Runner.

Try NodePit Runner!