---
title: "How to: Remove Duplicate Merge Indexes Using the Omit Operator"
slug: "omit-operator-removing-duplicate-merge-indexes"
description: "Learn how to use the Omit operator to remove duplicates in data sets while merging client information in this comprehensive guide."
updated: 2025-11-11T18:45:34Z
published: 2025-11-12T14:26:20Z
canonical: "docs.unqork.io/omit-operator-removing-duplicate-merge-indexes"
---

> ## Documentation Index
> Fetch the complete documentation index at: https://docs.unqork.io/llms.txt
> Use this file to discover all available pages before exploring further.

# How to: Remove Duplicate Merge Indexes Using the Omit Operator

UDesignerClassic Designer

The **Omit operator** removes specific data points from a data set. A good example for removing unwanted data is when you're working with a [Merge](/v1/docs/merge-operator) operator. When merging in a [Data Workflow](/v1/docs/data-workflow-component), you sometimes end up with duplicate indexes that you can remove using an Omit operator.

## Configuration

In this how-to guide, you'll set up a data table to store some sample client information. Then, you'll use a Data Workflow to take two columns from that data table and merge them into an array. Then, use an Omit operator to remove the duplicate index from that array. You'll include two [Console operators](/v1/docs/console-operator) in your Data Workflow so you can view your data before and after omitting the duplicate index.

> [!NOTE]
> These instructions assume you have a new module open, saved, and with a title.

### Configure the Data Table Component

First, let's set up some sample data in a [Data Table](/v1/docs/data-table-component) component.

1. In the Module Builder, drag and drop a **Data Table** component onto your canvas.
2. In the **Property ID** field, enter `dtClientInfo`.
3. In the data table, enter the following:

| # | A | B | C | D |
| --- | --- | --- | --- | --- |
| 1 | firstName | lastName | city | email |
| 2 | Sam | Smith | New York | sam@gmail.com |
| 3 | Matt | Walensky | Brooklyn | matt@gmail.com |
| 4 | Dafna | Klein | Chicago | dafna@gmail.com |
| 5 | Olga | Apply | Boston | olga@gmail.com |
| 6 | Shannon | Kempel | LA | shannon@gmail.com |

![A Data Table component displaying client information including names, cities, and emails.](https://cdn.us.document360.io/15548f06-2fba-434c-b0c1-5df88317dbd7/Images/Documentation/DuplicateMergeIndexes dtClientInfo.png?sv=2026-02-06&spr=https&st=2026-11-08T18%3A05%3A08Z&se=2026-11-08T19%3A05%3A08Z&sr=c&sp=r&sig=VYwh8n8VkdlCYoHUG1KTBbujuI6UpO2%2BN4wUThv%2F1Ic%3D)
4. Click **Save Component**.

### Configure the Data Workflow Component

Now, let's set up your [Data Workflow](/v1/docs/data-workflow-component) to separate the `city` and `email` data using two [Pick](/v1/docs/pick-operator) operators. Then, you'll merge that data into its own data set using a [Merge](/v1/docs/merge-operator) operator. To merge this data, you need to create an index for each item using two [Create Index](/v1/docs/create-index-operator) operators. Lastly, you’ll use an [Omit](/v1/docs/omit-operator) operator to remove your duplicate merge indexes.

1. Drag and drop a **Data Workflow** component onto your canvas, placing it below your Data Table component.
2. In the **Property ID** field, enter `dwfMergeAndOmit`.
3. In the **Canvas Label Text**, enter `dwfMergeAndOmit`.

![Data Workflow canvas illustrating data processing steps for merging and omitting client information.](https://cdn.us.document360.io/15548f06-2fba-434c-b0c1-5df88317dbd7/Images/Documentation/DuplicateMergeIndexes dwfMergeAndOmit.png?sv=2026-02-06&spr=https&st=2026-11-08T18%3A05%3A08Z&se=2026-11-08T19%3A05%3A08Z&sr=c&sp=r&sig=VYwh8n8VkdlCYoHUG1KTBbujuI6UpO2%2BN4wUThv%2F1Ic%3D)

#### Configure the Input Operator

1. Drag and drop an **Input** operator onto your Data Workflow canvas.
2. Configure the operator's **Info** window as follows:

| Setting | Value |
| --- | --- |
| Category | Input |
| Component | dtClientInfo |
| Required | Yes |
| Source | Default |

#### Configure the First Pick Operator

1. Drag and drop a **Pick** operator onto your Data Workflow canvas.
2. Configure the operator's **Info** window as follows:

| Setting | Value |
| --- | --- |
| Category | Pick |
| Label | Pick Email |
| Pick Keys | email |
3. Connect the output port (right) of the `dtClientInfo` **Input** operator to the input port (left) of the `Pick Email` **Pick** operator.

#### Configure the First Create Index Operator

1. Drag and drop a **Create Index** operator onto your Data Workflow canvas.
2. Configure the operator's **Info** window as follows:

| Setting | Value |
| --- | --- |
| Category | Create Index |
| Label | Email Index |
| Index Name | rowId |
| Starting Index | 1 |
| Keys |  |
3. Connect the output port (right) of the `Pick Email` **Pick** operator to the input port (left) of the `Email Index` **Create Index** operator.

#### Configure the Second Pick Operator

1. Drag and drop another **Pick** operator onto your Data Workflow canvas.
2. Configure the operator's **Info** window as follows:

| Setting | Value |
| --- | --- |
| Category | Pick |
| Label | Pick City |
| Pick Keys | city |
3. Connect the output port (right) of the `dtClientInfo` **Input** operator to the input port (left) of the `Pick City` **Pick** operator.

#### Configure the Second Create Index Operator

1. Drag and drop another **Create Index** operator onto your Data Workflow canvas.
2. Configure the operator's **Info** window as follows:

| Setting | Value |
| --- | --- |
| Category | Create Index |
| Label | City Index |
| Index Name | rowId |
| Starting Index | 1 |
| Keys |  |
3. Connect the output port (right) of the `Pick City` **Pick** operator to the input port (left) of the `City Index` **Create Index** operator.

#### Configure the Merge Operator

1. Drag and drop a **Merge** operator onto your Data Workflow canvas.
2. Configure the operator's **Info** window as follows:

| Setting | Value |
| --- | --- |
| Category | Merge |
| Label | Merge Email and City |
| Merge Type | Inner Left |
| Keep Flag | False |
| Renaming | Replace |
| Rows to Keep | First |
| Merge Key | rowId |
3. Connect the output port (right) of the `Email Index` **Create Index** operator to the upper input port (left) of the `Merge Email and City` **Merge** operator.
4. Connect the output port (right) of the `City Index` **Create Index** operator to the lower input port (left) of the `Merge Email and City` **Merge** operator.

#### Configure the First Console Operator

1. Drag and drop a **Console** operator onto your Data Workflow canvas.
2. Configure the operator's **Info** window as follows:

| Setting | Value |
| --- | --- |
| Category | Console |
| Label | Before Omit |
3. Connect the output port (right) of the `Merge Email and City` **Merge** operator to the input port (left) of the `Before Omit` **Console** operator.

#### Configure the Omit Operator

1. Drag and drop an **Omit** operator onto your Data Workflow canvas.
2. Configure the operator's **Info** window as follows:

| Setting | Value |
| --- | --- |
| Category | Omit |
| Label | Omit Duplicate Index |
| Omit Keys | rowId |
3. Connect the output port (right) of the `Merge Email and City` **Merge** operator to the input port (left) of the `Omit Duplicate Index` **Omit** operator.

#### Configure the Second Console Operator

1. Drag and drop another **Console** operator onto your Data Workflow canvas.
2. Configure the operator's **Info** window as follows:

| Setting | Value |
| --- | --- |
| Category | Console |
| Label | After Omit |
3. Connect the output port (right) of the `Omit Duplicate Index` **Omit** operator to the input port (left) of the `After Omit` **Console** operator.
4. Click **Save Component**.

### Configure the Button Component

Lastly, let's add a [Button](/v1/docs/button-component) component to trigger the entire operation.

1. Drag and drop a **Button** component onto your canvas, placing it below your Data Workflow.
2. In the **Property ID** field, enter `btnMerge`.
3. In the **Label Text** field, enter `Merge`.
4. Set the **Action Type** as **Event**.
5. From the **On Click** drop-down, select **dwfMergeAndOmit**.

![Button configuration with the Event Action Type selected and dwfMergeAndOmit selected from the On Click dropdown.](https://cdn.us.document360.io/15548f06-2fba-434c-b0c1-5df88317dbd7/Images/Documentation/DuplicateMergeIndexes btnMerge.png?sv=2026-02-06&spr=https&st=2026-11-08T18%3A05%3A08Z&se=2026-11-08T19%3A05%3A08Z&sr=c&sp=r&sig=VYwh8n8VkdlCYoHUG1KTBbujuI6UpO2%2BN4wUThv%2F1Ic%3D)
6. Click **Save Component**.
7. **Save** your module.

Here's how your module looks in the Module Builder:

![Module Builder displaying dtClientInfo Data Table, defMergeAndOmit Data Workflow, and btnMerge Button components.](https://cdn.us.document360.io/15548f06-2fba-434c-b0c1-5df88317dbd7/Images/Documentation/DuplicateMergeIndexes ModuleBuilder.png?sv=2026-02-06&spr=https&st=2026-11-08T18%3A05%3A08Z&se=2026-11-08T19%3A05%3A08Z&sr=c&sp=r&sig=VYwh8n8VkdlCYoHUG1KTBbujuI6UpO2%2BN4wUThv%2F1Ic%3D)

Preview your module in Express View and open the DevTools Console. Click the **Merge** button, and you'll see your data from your Data Workflow both before and after it passes through the Omit operator. In the `Before Omit` **Console**, you'll see the `rowId` key for each item in the array. In the `After Omit` **Console**, you'll see your data without the key.

![](https://cdn.us.document360.io/15548f06-2fba-434c-b0c1-5df88317dbd7/Images/Documentation/Dwf_OmitUseCase_Express(1).jpg?sv=2026-02-06&spr=https&st=2026-11-08T18%3A05%3A08Z&se=2026-11-08T19%3A05%3A08Z&sr=c&sp=r&sig=VYwh8n8VkdlCYoHUG1KTBbujuI6UpO2%2BN4wUThv%2F1Ic%3D)

The **Omit operator** removes specific data points from a data set. A good example for removing unwanted data is when you're working with a [Merge](/v1/docs/merge-operator) operator. When merging in a [Data Workflow](/v1/docs/data-workflow-component), you sometimes end up with duplicate indexes that you can remove using an Omit operator.

## Configuration

In this how-to guide, you'll set up a data table to store some sample client information. Then, you'll use a Data Workflow to take two columns from that data table and merge them into an array. Then, use an Omit operator to remove the duplicate index from that array. You'll include two [Console operators](/v1/docs/console-operator) in your Data Workflow so you can view your data before and after omitting the duplicate index.

> [!NOTE]
> These instructions assume you have a new module open, saved, and with a title.

### Configure the Data Table Component

First, let's set up some sample data in a [Data Table](/v1/docs/data-table-component) component.

1. In the Module Builder, drag and drop a **Data Table** component onto your canvas.
2. In the **Label** and **Property Name** fields, enter `dtClientInfo`.
3. In the data table, enter the following:

| # | A | B | C | D |
| --- | --- | --- | --- | --- |
| 1 | firstName | lastName | city | email |
| 2 | Sam | Smith | New York | sam@gmail.com |
| 3 | Matt | Walensky | Brooklyn | matt@gmail.com |
| 4 | Dafna | Klein | Chicago | dafna@gmail.com |
| 5 | Olga | Apply | Boston | olga@gmail.com |
| 6 | Shannon | Kempel | LA | shannon@gmail.com |

![](https://cdn.us.document360.io/15548f06-2fba-434c-b0c1-5df88317dbd7/Images/Documentation/Dwf_OmitUseCase_Dt.jpg?sv=2026-02-06&spr=https&st=2026-11-08T18%3A05%3A08Z&se=2026-11-08T19%3A05%3A08Z&sr=c&sp=r&sig=VYwh8n8VkdlCYoHUG1KTBbujuI6UpO2%2BN4wUThv%2F1Ic%3D)
4. Click **Save**.

### Configure the Data Workflow Component

Now, let's set up your [Data Workflow](/v1/docs/data-workflow-component) to separate the `city` and `email` data using two [Pick](/v1/docs/pick-operator) operators. Then, you'll merge that data into its own data set using a [Merge](/v1/docs/merge-operator) operator. To merge this data, you need to create an index for each item using two [Create Index](/v1/docs/create-index-operator) operators. Lastly, you’ll use an [Omit](/v1/docs/omit-operator) operator to remove your duplicate merge indexes.

1. Drag and drop a **Data Workflow** component onto your canvas, placing it below your Data Table component.
2. In the **Canvas Label Text** and **Property Name** fields, enter `dwfMergeAndOmit`.

![](https://cdn.us.document360.io/15548f06-2fba-434c-b0c1-5df88317dbd7/Images/Documentation/Dwf_OmitUseCase_Dwf.jpg?sv=2026-02-06&spr=https&st=2026-11-08T18%3A05%3A08Z&se=2026-11-08T19%3A05%3A08Z&sr=c&sp=r&sig=VYwh8n8VkdlCYoHUG1KTBbujuI6UpO2%2BN4wUThv%2F1Ic%3D)

#### Configure the Input Operator

1. Drag and drop an **Input** operator onto your Data Workflow canvas.
2. Configure the operator's **Info** window as follows:

| Setting | Value |
| --- | --- |
| Category | Input |
| Component | dtClientInfo |
| Required | Yes |
| Source | Default |

#### Configure the First Pick Operator

1. Drag and drop a **Pick** operator onto your Data Workflow canvas.
2. Configure the operator's **Info** window as follows:

| Setting | Value |
| --- | --- |
| Category | Pick |
| Label | Pick Email |
| Pick Keys | email |
3. Connect the output port (right) of the `dtClientInfo` **Input** operator to the input port (left) of the `Pick Email` **Pick** operator.

#### Configure the First Create Index Operator

1. Drag and drop a **Create Index** operator onto your Data Workflow canvas.
2. Configure the operator's **Info** window as follows:

| Setting | Value |
| --- | --- |
| Category | Create Index |
| Label | Email Index |
| Index Name | rowId |
| Starting Index | 1 |
| Keys |  |
3. Connect the output port (right) of the `Pick Email` **Pick** operator to the input port (left) of the `Email Index` **Create Index** operator.

#### Configure the Second Pick Operator

1. Drag and drop another **Pick** operator onto your Data Workflow canvas.
2. Configure the operator's **Info** window as follows:

| Setting | Value |
| --- | --- |
| Category | Pick |
| Label | Pick City |
| Pick Keys | city |
3. Connect the output port (right) of the `dtClientInfo` **Input** operator to the input port (left) of the `Pick City` **Pick** operator.

#### Configure the Second Create Index Operator

1. Drag and drop another **Create Index** operator onto your Data Workflow canvas.
2. Configure the operator's **Info** window as follows:

| Setting | Value |
| --- | --- |
| Category | Create Index |
| Label | City Index |
| Index Name | rowId |
| Starting Index | 1 |
| Keys |  |
3. Connect the output port (right) of the `Pick City` **Pick** operator to the input port (left) of the `City Index` **Create Index** operator.

#### Configure the Merge Operator

1. Drag and drop a **Merge** operator onto your Data Workflow canvas.
2. Configure the operator's **Info** window as follows:

| Setting | Value |
| --- | --- |
| Category | Merge |
| Label | Merge Email and City |
| Merge Type | Inner Left |
| Keep Flag | False |
| Renaming | Replace |
| Rows to Keep | First |
| Merge Key | rowId |
3. Connect the output port (right) of the `Email Index` **Create Index** operator to the upper input port (left) of the `Merge Email and City` **Merge** operator.
4. Connect the output port (right) of the `City Index` **Create Index** operator to the lower input port (left) of the `Merge Email and City` **Merge** operator.

#### Configure the First Console Operator

1. Drag and drop a **Console** operator onto your Data Workflow canvas.
2. Configure the operator's **Info** window as follows:

| Setting | Value |
| --- | --- |
| Category | Console |
| Label | Before Omit |
3. Connect the output port (right) of the `Merge Email and City` **Merge** operator to the input port (left) of the `Before Omit` **Console** operator.

#### Configure the Omit Operator

1. Drag and drop an **Omit** operator onto your Data Workflow canvas.
2. Configure the operator's **Info** window as follows:

| Setting | Value |
| --- | --- |
| Category | Omit |
| Label | Omit Duplicate Index |
| Omit Keys | rowId |
3. Connect the output port (right) of the `Merge Email and City` **Merge** operator to the input port (left) of the `Omit Duplicate Index` **Omit** operator.

#### Configure the Second Console Operator

1. Drag and drop another **Console** operator onto your Data Workflow canvas.
2. Configure the operator's **Info** window as follows:

| Setting | Value |
| --- | --- |
| Category | Console |
| Label | After Omit |
3. Connect the output port (right) of the `Omit Duplicate Index` **Omit** operator to the input port (left) of the `After Omit` **Console** operator.
4. Click **Save**.

### Configure the Button Component

Lastly, let's add a [Button](/v1/docs/button-component) component to trigger the entire operation.

1. Drag and drop a **Button** component onto your canvas, placing it below your Data Workflow component.
2. In the **Property ID** field, enter `btnMerge`.
3. In the **Label Text** field, enter `Merge`.
4. Select **Event** as the **Action Type**.
5. In the **Trigger on Click** field, enter `dwfMergeAndOmit`.

![](https://cdn.us.document360.io/15548f06-2fba-434c-b0c1-5df88317dbd7/Images/Documentation/Dwf_OmitUseCase_Btn.jpg?sv=2026-02-06&spr=https&st=2026-11-08T18%3A05%3A08Z&se=2026-11-08T19%3A05%3A08Z&sr=c&sp=r&sig=VYwh8n8VkdlCYoHUG1KTBbujuI6UpO2%2BN4wUThv%2F1Ic%3D)
6. Click **Save**.
7. **Save** your module.

Here's how your module looks in the Module Builder:

![](https://cdn.us.document360.io/15548f06-2fba-434c-b0c1-5df88317dbd7/Images/Documentation/Dwf_OmitUseCase_ME.jpg?sv=2026-02-06&spr=https&st=2026-11-08T18%3A05%3A08Z&se=2026-11-08T19%3A05%3A08Z&sr=c&sp=r&sig=VYwh8n8VkdlCYoHUG1KTBbujuI6UpO2%2BN4wUThv%2F1Ic%3D)

Preview your module in Express View and open the DevTools Console. Click the **Merge** button, and you'll see your data from your Data Workflow both before and after it passes through the Omit operator. In the `Before Omit` **Console**, you'll see the `rowId` key for each item in the array. In the `After Omit` **Console**, you'll see your data without the key.

![](https://cdn.us.document360.io/15548f06-2fba-434c-b0c1-5df88317dbd7/Images/Documentation/Dwf_OmitUseCase_Express(1).jpg?sv=2026-02-06&spr=https&st=2026-11-08T18%3A05%3A08Z&se=2026-11-08T19%3A05%3A08Z&sr=c&sp=r&sig=VYwh8n8VkdlCYoHUG1KTBbujuI6UpO2%2BN4wUThv%2F1Ic%3D)

The location of an element in an array.

An array is a type of object that stores one or more data types. Data types supported in arrays include numbers, strings, and objects.

A Property ID is the unique field ID used by Unqork to track and link components in your module.

Canvas Label Text indicates the purpose of the corresponding field or component. For non-input components, the Canvas Label Text isn't end-user facing, and only appears in the .

Label Text conveys what the input component is and what information it displays. Enter the purpose of the corresponding component or field.

The action performed by the button when selected.

Enter the Property ID of the component that you want to trigger on each button-click.

Express View is how your end-user views your application. Express View also lets you preview your applications to test your configuration and view the styling. This is also the view your end-users will see when interacting with your application. After configuring a module, click Preview in the Module Builder to interact with the module in Express View.

The DevTools Console helps you securely store, build, test, and deploy your software.

Label Text conveys what the input component is and what information it displays. Enter the purpose of the corresponding component or field.

A Property ID is the unique field ID used by Unqork to track and link components in your module.