Previous Next  

  Overview: Deployment & Execution

Key Info:

  • Deployment creates the tables, views, & stored procedures.
  • Execution loads the table(s) with data and runs the data cleansing procedure.

When a table is created or modified in Discovery Hub, the change will only initially appear within the UI. During this time, the table name will appear in red and the change will not be visible in the SQL server database. Saving the project at this point will save the metadata changes to the project repository.

Deployment and Execution is the process of creating and populating these tables in the SQL database.

The diagram below illustrates the deployment and execution process of a single table.

The orange and blue horizontal bars at the bottom of this diagram are similar to how the execution steps appear in the Discovery Hub execution window.

Deployment

Deployment is the process of creating (or updating) the tables, views, stored procedures, and SSIS Packages (if enabled) needed for discovery hub to do it's data processing. After deployment you are able to browse the database and see these objects persisted in SQL Server.

Discovery Hub automatically saves the project during deployment and, by default, will prompt for version details. This save is known as a "Deployed Version"

Options:

  1. Differential Deployment: When enabled, Discovery Hub calculates what steps require deployment (e.g. altering the raw table, or updating the data cleansing procedure.) and selects only those steps for deployment. When disabled, all steps are deployed.
  2. Managed Deployment : When enabled, Discovery Hub calculates dependencies and deploys the objects in the optimal order. When disabled, you need to ensure objects are deployed in the correct order.

Execution

Execution is the process of running the data transfer and data cleansing scripts to populate the table with data. Discovery Hub records the duration of each step within the execution process which can be later viewed for analysis. After an execution is complete you can query the table and see the data.

If Discovery Hub encounters an error during execution it will stop the process and display a prompt.

The Log will show all the steps in the execution process and at which point in the process the error occurred.

Double clicking on "Error Information" in the log will display the SQL Server error message. If an error occurs, it is important to read this error message carefully to diagnose and correct the error.