Description:
This step groups the same values into summary rows during the transformation.
Inputs
- groupColumns – Group by columns list
- valueColumns - Group by value list
Returns
- None
Usage:
Prerequisite:
The ETL process engine service should be running to execute the ETL definitions.
Example:
Let’s build and execute the “clsGroupByTransformDef” example.
- Create a new ETL definition called “clsGroupByTransformDef” and open the definition in designer mode.
- Drag “clsInputCSV, clsGroupByTransform, and clsOutputCSV” steps to the canvas.
- Connect the dots between the “clsInputCSV” and other steps, as shown above.
- Define a variable or a global to hold the virtual output path.
- Click the "clsInputCSV" step to configure its "Required" properties. Provide a name for the step. Provide the path to the input CSV file on the application server. Select the ETL data schema from the drop-down list. Note: The column names in the schema should match the columns in the input file. Click the Save button. Click here to learn about ETL Data Schema Designer.
- Click the "clsInputCSV" step to view its "Optional" properties. Select the Show Schema button. The pop-up window renders the schema columns as shown below. This function helps to understand the schema at a quick glance.
- Click the "clsGroupByTransform" step to configure its "Required" properties. Provide a name for the step. Click the button to configure the columns to transform. Click the Save button.
- Click the "clsGroupByTransform" step to configure its "Required" properties. Click the column button to configure the transform list. A pop-up window will appear for configuration. Click the Add Row (+) button to insert an empty row. Select the “Group By” column from the drop-down list. Click the Save button. You may add multiple columns for transformation by using the Add Row button.
- Click the "clsGroupByTransform" step to configure its "Required" properties. Click the operation button to configure the transform list. A pop-up window will appear for configuration. Click the Add Row (+) button to insert an empty row. Select the “Value” column from the drop-down list. Select the “Operator” to summarise the similar rows. Select the “Out” column from the drop-down list. You may also type in a new Out column name and press the Enter key to add. Click the Save button. You may add multiple columns for transformation by using the Add Row button.
- Click the "clsOutputCSV" step to configure its "Required" properties. Provide a name for the step. Provide the path to the output CSV file on the application server. Click the Save button.
- Click the "clsOutputCSV" step to configure its "Optional" properties. Provide a name for the step. Provide the variable or global reference to hold the virtual output path. Click the Save button.
- The “Logging” setting configuration is necessary for documentation and also measures the workflow progress and the percent complete. This is achieved by configuring the step state and percent fields individually, as shown below. Configure the “Logging” using the following properties.
- Save the ETL definition, create a new ETL instance, and execute. Render the ETL instance. Click the ETL step to view its properties. The “clsGroupByTransform” step should trim the text as configured to the output file. The variable/global holds the output file virtual path as below.
Definition Sample:
You may download the sample definition(s) from the link here and later import them (drag-and-drop) to your FlowWright ETL Definition (XML file) page.
Note: Please verify and complete the process steps for any missing configurations, such as file path references and database connections, after import. Then, save the definition to confirm the changes.