Description:
This step validates an ETL job.
Inputs
- etlDef – select ETL definition
- variablesToPass - pass selected variables
- globalsToPass - pass selected globals
- variableToStoreID – variables/globals to store ETL Instance ID
Returns
- AllRowsGood – returns all good rows
- GoodBadRows - returns good and bad row
- AllBadRows - returns all bad rows
Usage:
Example:
Let’s build and execute the “clsExecuteETLValidationJobDef” example.
- Create a new process definition named “clsExecuteETLValidationJobDef” and open it in designer mode.
- Drag “clsExecuteETLValidationJob and placeholder” step to the canvas.
- Connect the dots between the “Start” and “clsExecuteETLValidationJob” steps, as shown above.
- Select the connection lines and configure the appropriate workflow paths for the step returns - “AllRowsGood, AllBadRows, and GoodBadRows”.
- Define a variable or a global to store the ETL Instance ID and the output file path.
- Click the "clsExecuteETLValidationJob" step to configure its "Required" properties. Provide a name for the step, then select the ETL definition from the drop-down list. Click the Save button. Note: Click the "AI Predict" button to have the Copilot add new process steps that match your process description.
- Click the "clsExecuteETLValidationJob" step to configure its "Optional" properties. Click the button to configure multiple variables and globals that will be passed to the ETL instance at execution. Provide the variable or global reference to store the ETL instance ID. Then click the Save button.
- Click the button to configure variables to pass to the ETL instance, as shown below. A pop-up window opens for configuration. Click the Add Row (+) button to insert an empty row. Select a variable from the drop-down list. Click the Save button. You may add multiple variables by using the Add Row button.
- Click the button to configure the globals to pass to the ETL instance, as shown below. A pop-up window opens for configuration. Click the Add Row (+) button to insert an empty row. Select a global from the drop-down list. Click the Save button. You may add multiple globals by using the Add Row button.
- The “Logging” setting configuration is necessary for documentation and also measures the workflow progress and the percent complete. This is achieved by configuring the step state and percent fields individually, as shown below. Configure the “Logging” using the following properties.
- Navigate to the Process Definition page. Save the process definition, create a new instance, and execute it. Render the process instance. This “clsExecuteETLValidationJob” step shall validate the configured ETL job.
- Navigate to the ETL Instances page. Render the instance shown above. The ETL process execution is shown below.
Definition Sample:
You may download the sample definition(s) from the link provided and later import them (drag-and-drop) into your FlowWright Process Definition (XML file) or Form Definition (HTML file) page.
Note: Please verify and complete the process steps for any missing configurations, such as file path references and database connections, after the import. Then, save the definition to confirm the changes.