Bosch IoT Insights

Reprocessing the input history

Already processed data can be reprocessed in case the pipeline which was used for processing the data in the first place has been changed.

For projects without pipelines, the old processed data is deleted and then reprocessed. For projects with pipelines, the processed data is not deleted only reprocessed.

images/confluence/download/attachments/1332383661/PROCESSING_processing_input_history_2023_05_25-version-1-modificationdate-1687420335000-api-v2.png

Prerequisites

You are assigned to the Admin role.

Reprocessing the input history

All entries in the input history can be reprocessed.

For Non-Premium Plan Project, proceed as follows

  1. Optionally, set a filter to narrow down the list of input history entries.

  2. Click the Reprocess button.
    → The Reprocess by filter dialog is displayed.

    images/confluence/download/attachments/1332383661/reprocess_dialog_non_premium-version-2-modificationdate-1603703818000-api-v2.png

  3. Click the Reprocess filtered button to reprocess all input history entries.
    → Whether the reprocessing has been successful or not is displayed in the Processing Information tab. The result in form of the processed data can be seen in the Data Explorer which is linked in the Processing Information tab.

For Premium Plan Project, proceed as follows

  1. Optionally, set a filter to narrow down the list of input history entries.

  2. Click the Reprocess button.
    → The Reprocessing dialog is displayed.

    images/confluence/download/attachments/1332383661/reprocess_dialog_premium-version-3-modificationdate-1690270204000-api-v2.png
  3. In the Processing Pipeline drop-down list, select the pipeline with which the data shall be reprocessed.

  4. Select for each Pipeline the amount of instances that should be started to reprocess the data.

  5. Optionally, enter an Input Data Query to select which data should be reprocessed.

  6. Optionally, enter a query to sort the input files.

  7. Click the Yes, reprocess button to start the reprocessing.
    → You will automatically be forwarded to the Pipelines tab. Whether the reprocessing has been successful or not is displayed in the Processing Information tab. The result in form of the processed data can be seen in the Data Explorer which is linked in the Processing Information tab.

Reprocessing an input history entry

Individual input history entries can be reprocessed.

Proceed as follows

  1. Optionally, set a filter to narrow down the list of input history entries.

  2. Click the Reprocess input data icon images/confluence/download/thumbnails/1332383661/icon_input_history_reprocess_input_data-version-1-modificationdate-1618841390000-api-v2.png in the line of the input history entry that shall be reprocessed.
    → The Reprocessing dialog is displayed.

  3. In the Processing Pipeline drop-down list, select the pipeline with which the data shall be reprocessed.

  4. Select for each Pipeline the amount of instances that should be started to reprocess the data.

  5. Optionally, enter an Input Data Query to select which data should be reprocessed.

  6. Optionally, enter a query to sort the input files.

  7. Click the Yes, reprocess button to start the reprocessing.
    → You will automatically be forwarded to the Pipelines tab. Whether the reprocessing has been successful or not is displayed in the Processing Information tab. The result in form of the processed data can be seen in the Data Explorer which is linked in the Processing Information tab.

Upscaling a reprocessing job

To increase the performance of a reprocessing job, an additional instance can be started within the reprocessing job.

images/confluence/download/attachments/1332383661/processing_pipelines_reprocessing_scale_up-version-1-modificationdate-1692282911000-api-v2.png

Proceed as follows

  1. Start a reprocessing job as described in Reprocessing the input history or Reprocessing an input history entry.
    → You will automatically be forwarded to the Pipelines tab. The Scale Up button is displayed after a short while.

  2. Click the Scale Up button.
    → The running reprocessing job will be executed much faster.

    Keep in mind that this action consumes additional RAM.

Viewing the details of a reprocessing job

To view the details of a reprocessing job, refer to Managing reprocessing jobs.